Apr 13 23:58:25 user devstack@n-api.service[72772]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 23:58:25 user devstack@n-api.service[72772]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 23:58:25 2023] *** Apr 13 23:58:25 user devstack@n-api.service[72772]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 23:58:25 user devstack@n-api.service[72772]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 23:58:25 user devstack@n-api.service[72772]: nodename: user Apr 13 23:58:25 user devstack@n-api.service[72772]: machine: x86_64 Apr 13 23:58:25 user devstack@n-api.service[72772]: clock source: unix Apr 13 23:58:25 user devstack@n-api.service[72772]: pcre jit disabled Apr 13 23:58:25 user devstack@n-api.service[72772]: detected number of CPU cores: 12 Apr 13 23:58:25 user devstack@n-api.service[72772]: current working directory: / Apr 13 23:58:25 user devstack@n-api.service[72772]: detected binary path: /usr/bin/uwsgi-core Apr 13 23:58:25 user devstack@n-api.service[72772]: your processes number limit is 63637 Apr 13 23:58:25 user devstack@n-api.service[72772]: your memory page size is 4096 bytes Apr 13 23:58:25 user devstack@n-api.service[72772]: detected max file descriptor number: 2048 Apr 13 23:58:25 user devstack@n-api.service[72772]: lock engine: pthread robust mutexes Apr 13 23:58:25 user devstack@n-api.service[72772]: thunder lock: enabled Apr 13 23:58:25 user devstack@n-api.service[72772]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 23:58:25 user devstack@n-api.service[72772]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 23:58:25 user devstack@n-api.service[72772]: Python main interpreter initialized at 0x56412dde7990 Apr 13 23:58:25 user devstack@n-api.service[72772]: python threads support enabled Apr 13 23:58:25 user devstack@n-api.service[72772]: your server socket listen backlog is limited to 100 connections Apr 13 23:58:25 user devstack@n-api.service[72772]: your mercy for graceful operations on workers is 90 seconds Apr 13 23:58:25 user devstack@n-api.service[72772]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 23:58:25 user devstack@n-api.service[72772]: *** Operational MODE: preforking *** Apr 13 23:58:25 user devstack@n-api.service[72772]: *** uWSGI is running in multiple interpreter mode *** Apr 13 23:58:25 user devstack@n-api.service[72772]: spawned uWSGI master process (pid: 72772) Apr 13 23:58:25 user devstack@n-api.service[72772]: spawned uWSGI worker 1 (pid: 72773, cores: 1) Apr 13 23:58:25 user devstack@n-api.service[72772]: spawned uWSGI worker 2 (pid: 72774, cores: 1) Apr 13 23:58:25 user devstack@n-api.service[72772]: spawned uWSGI worker 3 (pid: 72775, cores: 1) Apr 13 23:58:25 user devstack@n-api.service[72772]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 23:58:25 user devstack@n-api.service[72774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 23:58:25 user devstack@n-api.service[72775]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 23:58:26 user devstack@n-api.service[72773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 23:58:29 user devstack@n-api.service[72774]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 23:58:29 user devstack@n-api.service[72774]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 23:58:29 user devstack@n-api.service[72774]: and ``live_migration_inbound_addr`` respectively. Apr 13 23:58:29 user devstack@n-api.service[72774]: ). Its value may be silently ignored in the future. Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 23:58:29 user devstack@n-api.service[72775]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 23:58:29 user devstack@n-api.service[72775]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 23:58:29 user devstack@n-api.service[72775]: and ``live_migration_inbound_addr`` respectively. Apr 13 23:58:29 user devstack@n-api.service[72775]: ). Its value may be silently ignored in the future. Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 23:58:29 user devstack@n-api.service[72773]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 23:58:29 user devstack@n-api.service[72773]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 23:58:29 user devstack@n-api.service[72773]: and ``live_migration_inbound_addr`` respectively. Apr 13 23:58:29 user devstack@n-api.service[72773]: ). Its value may be silently ignored in the future. Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72773) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 23:58:29 user devstack@n-api.service[72774]: INFO dbcounter [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Registered counter for database nova_api Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_db.sqlalchemy.engines [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writer thread running {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72775]: INFO dbcounter [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Registered counter for database nova_api Apr 13 23:58:29 user devstack@n-api.service[72773]: INFO dbcounter [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Registered counter for database nova_api Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG nova.context [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6321059f-07f5-4513-ac20-9516172f61da(cell1) {{(pid=72774) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_db.sqlalchemy.engines [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_db.sqlalchemy.engines [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72773) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:58:29 user devstack@n-api.service[72774]: INFO dbcounter [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Registered counter for database nova_cell0 Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writer thread running {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writer thread running {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72774]: INFO dbcounter [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Registered counter for database nova_cell1 Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_db.sqlalchemy.engines [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writer thread running {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG nova.context [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6321059f-07f5-4513-ac20-9516172f61da(cell1) {{(pid=72773) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG nova.context [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6321059f-07f5-4513-ac20-9516172f61da(cell1) {{(pid=72775) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 23:58:29 user devstack@n-api.service[72773]: INFO dbcounter [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Registered counter for database nova_cell0 Apr 13 23:58:29 user devstack@n-api.service[72775]: INFO dbcounter [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Registered counter for database nova_cell0 Apr 13 23:58:29 user devstack@n-api.service[72773]: INFO dbcounter [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Registered counter for database nova_cell1 Apr 13 23:58:29 user devstack@n-api.service[72775]: INFO dbcounter [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Registered counter for database nova_cell1 Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_db.sqlalchemy.engines [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72773) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writer thread running {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_db.sqlalchemy.engines [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_db.sqlalchemy.engines [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72773) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writer thread running {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_db.sqlalchemy.engines [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writer thread running {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72774]: INFO dbcounter [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Registered counter for database nova_cell0 Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG oslo_db.sqlalchemy.engines [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writer thread running {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writer thread running {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_db.sqlalchemy.engines [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writer thread running {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72773]: INFO dbcounter [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Registered counter for database nova_cell0 Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG oslo_db.sqlalchemy.engines [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72773) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writer thread running {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72775]: INFO dbcounter [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Registered counter for database nova_cell0 Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG oslo_db.sqlalchemy.engines [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 23:58:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writer thread running {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 23:58:29 user devstack@n-api.service[72774]: WARNING keystonemiddleware.auth_token [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 23:58:29 user devstack@n-api.service[72774]: WARNING keystonemiddleware.auth_token [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 23:58:29 user devstack@n-api.service[72773]: WARNING keystonemiddleware.auth_token [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 23:58:29 user devstack@n-api.service[72773]: WARNING keystonemiddleware.auth_token [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 23:58:29 user devstack@n-api.service[72775]: WARNING keystonemiddleware.auth_token [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 23:58:29 user devstack@n-api.service[72775]: WARNING keystonemiddleware.auth_token [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 23:58:30 user devstack@n-api.service[72774]: WARNING keystonemiddleware.auth_token [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 23:58:30 user devstack@n-api.service[72774]: WARNING keystonemiddleware.auth_token [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 23:58:30 user devstack@n-api.service[72774]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56412dde7990 pid: 72774 (default app) Apr 13 23:58:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 23:58:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001507 Apr 13 23:58:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 23:58:30 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 23:58:30 user devstack@n-api.service[72773]: WARNING keystonemiddleware.auth_token [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 23:58:30 user devstack@n-api.service[72773]: WARNING keystonemiddleware.auth_token [None req-6d192460-ab47-468d-86d3-b1f5a865a0f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 23:58:30 user devstack@n-api.service[72773]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56412dde7990 pid: 72773 (default app) Apr 13 23:58:30 user devstack@n-api.service[72775]: WARNING keystonemiddleware.auth_token [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 23:58:30 user devstack@n-api.service[72775]: WARNING keystonemiddleware.auth_token [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 23:58:30 user devstack@n-api.service[72775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56412dde7990 pid: 72775 (default app) Apr 14 00:00:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-270bb59c-8bee-452a-b6b6-525328f2d246 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001359 Apr 14 00:00:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c231a736-8228-4fc9-a80b-cabf1f85b130 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c231a736-8228-4fc9-a80b-cabf1f85b130 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.440169 Apr 14 00:00:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 00:00:38 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:41 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:41 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003612 Apr 14 00:00:41 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:41 2023] GET /compute/v2.1 => generated 387 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:41 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:41 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:41 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:41 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c617c7db-6a46-4a8c-b4c5-1dc11f9b0f00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "swap": 0}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c617c7db-6a46-4a8c-b4c5-1dc11f9b0f00 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451298 Apr 14 00:00:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:41 2023] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9802a3f2-15bf-4827-9e62-ceb2fbd6ae80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9802a3f2-15bf-4827-9e62-ceb2fbd6ae80 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050249 Apr 14 00:00:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 00:00:41 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:43 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:43 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001515 Apr 14 00:00:43 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-273926af-9f5e-462f-9eb4-9223a8b437c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "swap": 0}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-273926af-9f5e-462f-9eb4-9223a8b437c2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.093282 Apr 14 00:00:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:43 2023] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9b6fac32-844d-49c0-9436-519b0866bca3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9b6fac32-844d-49c0-9436-519b0866bca3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027822 Apr 14 00:00:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 00:00:43 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:46 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:46 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001574 Apr 14 00:00:46 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ed1ce850-1485-46f5-b85c-d3af5ccd71a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ed1ce850-1485-46f5-b85c-d3af5ccd71a1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066929 Apr 14 00:00:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bc024293-6d52-4353-a3a8-b7e405585082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bc024293-6d52-4353-a3a8-b7e405585082 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030944 Apr 14 00:00:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 00:00:46 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:48 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:48 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001617 Apr 14 00:00:48 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:48 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-74c69fb4-3b60-4e95-b78a-2cf257b6b2ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-74c69fb4-3b60-4e95-b78a-2cf257b6b2ff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084113 Apr 14 00:00:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-98a8ecbd-028d-4764-a363-e8f1e740e904 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-98a8ecbd-028d-4764-a363-e8f1e740e904 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027835 Apr 14 00:00:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 00:00:48 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:50 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001520 Apr 14 00:00:50 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3294f846-641d-45e0-b3ae-c1c05bb9831c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "id": "d4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3294f846-641d-45e0-b3ae-c1c05bb9831c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071069 Apr 14 00:00:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:50 2023] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028894 Apr 14 00:00:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 00:00:50 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f1c32bfa-9843-4f48-809e-349355842331 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001603 Apr 14 00:00:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-35edc660-fc25-4ed1-84cf-fe3b080045f5 admin admin] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-35edc660-fc25-4ed1-84cf-fe3b080045f5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.089171 Apr 14 00:00:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 00:00:52 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:00:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002017 Apr 14 00:00:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:00:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-c08f71e2-2d6e-4ba3-9d15-82ede71a61d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "ram": 512}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-c08f71e2-2d6e-4ba3-9d15-82ede71a61d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.367918 Apr 14 00:00:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:54 2023] POST /compute/v2.1/flavors => generated 400 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-eb590054-2122-4eb8-8bc8-2e0d7f36c0eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-eb590054-2122-4eb8-8bc8-2e0d7f36c0eb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037074 Apr 14 00:00:54 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 00:00:54 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001647 Apr 14 00:00:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:56 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:56 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1512294b-f44b-45da-945b-b78aad857a65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:56 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-1512294b-f44b-45da-945b-b78aad857a65 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059736 Apr 14 00:00:56 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:56 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-17a342a8-45d0-4782-ac89-843fa78543d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-17a342a8-45d0-4782-ac89-843fa78543d0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027132 Apr 14 00:00:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 00:00:56 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:00:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:00:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001595 Apr 14 00:00:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:00:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:00:58 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-635f02fd-722d-4789-9df9-e1e8117a24e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:58 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-635f02fd-722d-4789-9df9-e1e8117a24e6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061847 Apr 14 00:00:58 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:00:58 2023] POST /compute/v2.1/flavors => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:00:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-69452952-4cd2-4f5a-a761-df4b95e1b44a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:00:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-69452952-4cd2-4f5a-a761-df4b95e1b44a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036488 Apr 14 00:00:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 00:00:58 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:01:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:01:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001757 Apr 14 00:01:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:01:00 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:01:00 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-2637ca4f-750e-4453-96b1-3c6acb1fde0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:01:00 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-2637ca4f-750e-4453-96b1-3c6acb1fde0c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066717 Apr 14 00:01:00 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:01:00 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:01:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0a46aa13-fcdf-471a-85d6-9841366d67a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:01:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0a46aa13-fcdf-471a-85d6-9841366d67a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029356 Apr 14 00:01:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 00:01:00 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:01:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:01:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001708 Apr 14 00:01:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 00:01:02 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:01:02 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-842c7d6a-4baf-4a00-8c5a-d5203a51b96d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:01:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-842c7d6a-4baf-4a00-8c5a-d5203a51b96d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.063578 Apr 14 00:01:02 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 00:01:02 2023] POST /compute/v2.1/flavors => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:01:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7d361283-53ad-4435-88d8-57ed153efce0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:01:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7d361283-53ad-4435-88d8-57ed153efce0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030082 Apr 14 00:01:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 00:01:02 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:01:33 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:01:33 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96f240c5-1103-4eb1-af58-001f66138241 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001597 Apr 14 00:01:33 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 00:01:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:01:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:01:33 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.106311 Apr 14 00:01:33 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 00:01:33 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:02:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7d361283-53ad-4435-88d8-57ed153efce0 admin admin] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:02:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7d361283-53ad-4435-88d8-57ed153efce0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001726 Apr 14 00:02:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 00:02:05 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:02:05 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:02:06 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bae616e7-baa4-408b-88b4-0fbfb11e488e admin admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:02:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bae616e7-baa4-408b-88b4-0fbfb11e488e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.066894 Apr 14 00:02:06 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 00:02:05 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:02:10 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:02:10 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001738 Apr 14 00:02:10 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 00:02:10 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:02:10 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:02:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1d2b877f-1a5a-4b48-ba33-a6e0bab17001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "id": "42", "name": "m1.nano"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:02:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1d2b877f-1a5a-4b48-ba33-a6e0bab17001 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.239697 Apr 14 00:02:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 00:02:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:02:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-351df552-b110-49da-8260-789f49eecc86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:02:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-351df552-b110-49da-8260-789f49eecc86 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026076 Apr 14 00:02:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 00:02:10 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:02:14 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:02:14 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-aaedaa98-1d24-4208-855d-9fa2f8a22fe9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002781 Apr 14 00:02:14 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 00:02:14 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:02:14 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ff1dca6f-e440-4e1f-92ef-171d5110877b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.micro", "os-flavor-access:is_public": true, "disk": 1, "ram": 192, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:02:14 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ff1dca6f-e440-4e1f-92ef-171d5110877b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.062674 Apr 14 00:02:14 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 00:02:14 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:02:14 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-447ad0aa-a946-4c6c-8f09-22d9c9080119 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:02:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-447ad0aa-a946-4c6c-8f09-22d9c9080119 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024842 Apr 14 00:02:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 00:02:14 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:04:45 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:45 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:45 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:45 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-53f76608-2d5c-42a6-a98a-ede79a463259 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Action: 'create', calling method: .version_select at 0x7f3db78fd360>, body: {"keypair": {"name": "tempest-keypair-1540032684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuJ+sB897ViN2VTH0JXlcH9ndfvRNhk01+KgyuP9jwhkZ5ef42HmlxNSsq22e8Y5akz0iE7TkYd8Z+WgwsB4uFLI7jFktxjc9ufhBjq2ACCm1woK6wgYMrlECKBNQ8fA=="}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:45 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-53f76608-2d5c-42a6-a98a-ede79a463259 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting quotas for project c931198e56de4cf08db59bcc40f2a260. Resources: {'key_pairs'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:45 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-53f76608-2d5c-42a6-a98a-ede79a463259 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting quotas for user 97374cd3cdc448cd8710561d44756ead and project c931198e56de4cf08db59bcc40f2a260. Resources: {'key_pairs'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:45 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-53f76608-2d5c-42a6-a98a-ede79a463259 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291735 Apr 14 00:04:45 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:04:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:04:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-05ff5029-c8ad-4f73-b402-c3678c25703e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'create', calling method: .version_select at 0x7f3db78a2290>, body: {"keypair": {"name": "tempest-keypair-138977160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS95AsHXsHQ5WUo+qNFwgIJLlEtcpS8GwdztFmcvwprZsn2CsvfRn9jDCwGdOGL9HuU0oylsscRpNL9zF0nJQKzqNgC5UVyUERTxALD/prKFHPNrGlE0h48XNBp/faanQ=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:49 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-05ff5029-c8ad-4f73-b402-c3678c25703e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:49 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-05ff5029-c8ad-4f73-b402-c3678c25703e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for user 2f8b18d40ecd4b4e976cf2018af8220c and project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-05ff5029-c8ad-4f73-b402-c3678c25703e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.229654 Apr 14 00:04:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 17/47] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 00:04:49 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 00:04:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1972873917", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "598c3cc3-627d-4abe-beb6-93721d4334a1"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:50 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-762920045", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "491696ea-38ef-4c19-9d94-a61223c1fa00"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:50 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] validate_networks() for [('598c3cc3-627d-4abe-beb6-93721d4334a1', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:04:50 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] validate_networks() for [('491696ea-38ef-4c19-9d94-a61223c1fa00', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:04:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c5ad4986-ad9a-42a9-9475-6bfa5e1cae76 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: .version_select at 0x7f3db7726b90>, body: {"keypair": {"name": "tempest-keypair-608426082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:50 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-c5ad4986-ad9a-42a9-9475-6bfa5e1cae76 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:50 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-c5ad4986-ad9a-42a9-9475-6bfa5e1cae76 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for user 44530987616b417d87ce5909d8de1871 and project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c5ad4986-ad9a-42a9-9475-6bfa5e1cae76 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162494 Apr 14 00:04:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 18/48] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:04:50 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Getting quotas for project 834d867e665a4671a901218d21fa8704. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Getting quotas for user 457273b82bcb4fa6bbee81fdd9e0265c and project 834d867e665a4671a901218d21fa8704. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:04:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.488042 Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:04:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:04:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 2490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7035f68c-b3c8-46a8-9fda-c11e4e52d9b8 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:04:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7035f68c-b3c8-46a8-9fda-c11e4e52d9b8 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for user 90bad96535c3453792982c5acab9dbc6 and project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:04:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1358925619", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74"}], "security_groups": [{"name": "tempest-securitygroup--1306876311"}], "key_name": "tempest-keypair-1540032684", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.357678 Apr 14 00:04:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 16/50] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:04:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-e2cf6daf-91aa-45fa-a22c-7596778947d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-e2cf6daf-91aa-45fa-a22c-7596778947d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-e2cf6daf-91aa-45fa-a22c-7596778947d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-e2cf6daf-91aa-45fa-a22c-7596778947d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:52 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-e2cf6daf-91aa-45fa-a22c-7596778947d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-e2cf6daf-91aa-45fa-a22c-7596778947d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 200 len: 1394 microversion: 2.87 time: 0.185706 Apr 14 00:04:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:04:52 2023] GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 1394 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 00:04:52 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7035f68c-b3c8-46a8-9fda-c11e4e52d9b8 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457273b82bcb4fa6bbee81fdd9e0265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834d867e665a4671a901218d21fa8704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7035f68c-b3c8-46a8-9fda-c11e4e52d9b8 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 200 len: 1209 microversion: 2.1 time: 0.422687 Apr 14 00:04:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 19/52] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:04:52 2023] GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 1209 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:04:53 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] validate_networks() for [('10c34d1a-edc4-4b0c-96a7-b29a7c292e74', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting quotas for project c931198e56de4cf08db59bcc40f2a260. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting quotas for user 97374cd3cdc448cd8710561d44756ead and project c931198e56de4cf08db59bcc40f2a260. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:04:54 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:04:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.089649 Apr 14 00:04:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 17/53] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:04:52 2023] POST /compute/v2.1/servers => generated 404 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:04:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-e9a2139a-afd2-4b02-bbd3-f9ded72a0c28 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:04:54 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-e9a2139a-afd2-4b02-bbd3-f9ded72a0c28 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:04:54 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-e9a2139a-afd2-4b02-bbd3-f9ded72a0c28 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-e9a2139a-afd2-4b02-bbd3-f9ded72a0c28 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1240 microversion: 2.1 time: 0.129118 Apr 14 00:04:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:04:54 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:04:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-353632356", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "66316d10-fed3-4fb9-877e-a01542ca5855"}], "security_groups": [{"name": "tempest-securitygroup--1067205689"}], "key_name": "tempest-keypair-138977160", "user_data": "}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-dd9a15c9-5629-4933-9609-5d24069f8c29 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'create', calling method: .version_select at 0x7f3db7726cb0>, body: {"keypair": {"name": "tempest-keypair-1040271550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:56 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-dd9a15c9-5629-4933-9609-5d24069f8c29 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:56 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-dd9a15c9-5629-4933-9609-5d24069f8c29 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-dd9a15c9-5629-4933-9609-5d24069f8c29 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123853 Apr 14 00:04:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:04:56 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:04:57 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] validate_networks() for [('66316d10-fed3-4fb9-877e-a01542ca5855', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:04:57 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-874047723", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "368d9445-850e-4f74-b5cc-86d1eaa95d63"}], "security_groups": [{"name": "tempest-securitygroup--202723400"}], "key_name": "tempest-keypair-608426082", "user_data": "}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:04:58 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] validate_networks() for [('368d9445-850e-4f74-b5cc-86d1eaa95d63', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for user 2f8b18d40ecd4b4e976cf2018af8220c and project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:04:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:04:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.154022 Apr 14 00:04:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 18/56] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:04:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:04:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-357da7d9-07a1-4c23-a620-d921113722fd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:04:58 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-357da7d9-07a1-4c23-a620-d921113722fd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:04:58 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-357da7d9-07a1-4c23-a620-d921113722fd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:58 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-357da7d9-07a1-4c23-a620-d921113722fd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:58 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-357da7d9-07a1-4c23-a620-d921113722fd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-357da7d9-07a1-4c23-a620-d921113722fd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1274 microversion: 2.20 time: 0.141975 Apr 14 00:04:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 21/57] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:04:58 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for user 44530987616b417d87ce5909d8de1871 and project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:04:59 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:04:59 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.942752 Apr 14 00:04:59 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:04:57 2023] POST /compute/v2.1/servers => generated 399 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:04:59 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8b999c87-8a24-41f8-bda9-70a27220efb6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:04:59 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8b999c87-8a24-41f8-bda9-70a27220efb6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:04:59 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8b999c87-8a24-41f8-bda9-70a27220efb6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:04:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8b999c87-8a24-41f8-bda9-70a27220efb6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1230 microversion: 2.1 time: 0.219464 Apr 14 00:04:59 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 19/59] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:04:59 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1230 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae47769-02cd-4118-af46-0d3521ef7564", "tag": "43fb1710-4018-42d7-88ad-b5cb3970204a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Creating event network-changed:43fb1710-4018-42d7-88ad-b5cb3970204a for instance cae47769-02cd-4118-af46-0d3521ef7564 on user Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72774) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72774) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:01 user devstack@n-api.service[72774]: INFO nova.compute.rpcapi [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 00:05:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] Releasing lock "compute-rpcapi-router" {{(pid=72774) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 00:05:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1ef6758e-f349-4bc4-8674-6f3b24c4a350 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310586 Apr 14 00:05:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 22/60] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23718fd0-58b8-47f9-b1ef-a26a90741ecc", "tag": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Creating event network-changed:db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc on user Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72775) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=72775) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:02 user devstack@n-api.service[72775]: INFO nova.compute.rpcapi [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 00:05:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=72775) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 00:05:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-68cb6655-e095-473a-9bda-bff7300e90f8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220338 Apr 14 00:05:02 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2144192259", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e"}], "security_groups": [{"name": "tempest-securitygroup--155365803"}], "key_name": "tempest-keypair-1040271550", "user_data": "}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:03 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Creating event network-changed:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:05:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061494 Apr 14 00:05:03 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 23/62] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:03 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] validate_networks() for [('cb8c9bb1-a885-486d-aa6a-de600bc01c2e', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:05 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Creating event network-changed:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:05:05 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054928 Apr 14 00:05:05 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:05:05 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:05:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.198356 Apr 14 00:05:05 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 20/64] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:05:03 2023] POST /compute/v2.1/servers => generated 406 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:05:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ee598ff0-2e91-4825-93f4-ae77b2633266 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:05 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ee598ff0-2e91-4825-93f4-ae77b2633266 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:05 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-ee598ff0-2e91-4825-93f4-ae77b2633266 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ee598ff0-2e91-4825-93f4-ae77b2633266 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1233 microversion: 2.1 time: 0.089175 Apr 14 00:05:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 24/65] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:05 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1233 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:05 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:05 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Creating event network-changed:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:05:05 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093535 Apr 14 00:05:05 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23718fd0-58b8-47f9-b1ef-a26a90741ecc", "name": "network-vif-plugged", "status": "completed", "tag": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Creating event network-vif-plugged:db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc on user Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72773) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72773) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:10 user devstack@n-api.service[72773]: INFO nova.compute.rpcapi [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 00:05:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] Releasing lock "compute-rpcapi-router" {{(pid=72773) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 00:05:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-af93c541-eecd-45fb-99e7-901dd5ea282d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207453 Apr 14 00:05:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 21/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Creating event network-changed:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:05:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041861 Apr 14 00:05:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 25/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:11 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=20 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:11 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:05:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187059 Apr 14 00:05:11 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23718fd0-58b8-47f9-b1ef-a26a90741ecc", "name": "network-vif-plugged", "status": "completed", "tag": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3"}, {"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}, {"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Creating event network-vif-plugged:db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc on user Apr 14 00:05:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:05:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:05:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.059716 Apr 14 00:05:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 22/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:13 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}, {"server_uuid": "cae47769-02cd-4118-af46-0d3521ef7564", "name": "network-vif-plugged", "status": "completed", "tag": "43fb1710-4018-42d7-88ad-b5cb3970204a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:13 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:05:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Creating event network-vif-plugged:43fb1710-4018-42d7-88ad-b5cb3970204a for instance cae47769-02cd-4118-af46-0d3521ef7564 on user Apr 14 00:05:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113801 Apr 14 00:05:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 26/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:14 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:15 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-7ccc52f3-0875-448b-a0d6-bcbd419d36b6 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Action: 'create', calling method: .version_select at 0x7f3db7655bd0>, body: {"keypair": {"name": "tempest-keypair-1590246000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBRuOZjQvIE5tUmB4tfzvZRoCYk3Hsf5VhCBAOOcUwojgjny9UgepaV8G6SqWjUYPvwtt/SH5yQUW3rdVohRimKNBakqIU+mWsl0P0s23cgMalDbSnHqVnUTBlbtWKWsg=="}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:15 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-7ccc52f3-0875-448b-a0d6-bcbd419d36b6 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Getting quotas for project ccde4d67c2ed45af968e5f219cc8b6c2. Resources: {'key_pairs'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:15 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=7 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:15 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-7ccc52f3-0875-448b-a0d6-bcbd419d36b6 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Getting quotas for user b3bff58a90484c5db3f035ab1187080e and project ccde4d67c2ed45af968e5f219cc8b6c2. Resources: {'key_pairs'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:15 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-7ccc52f3-0875-448b-a0d6-bcbd419d36b6 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.510648 Apr 14 00:05:15 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:05:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:16 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=18 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:16 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=26 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:16 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae47769-02cd-4118-af46-0d3521ef7564", "name": "network-vif-plugged", "status": "completed", "tag": "43fb1710-4018-42d7-88ad-b5cb3970204a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-plugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Creating event network-vif-plugged:43fb1710-4018-42d7-88ad-b5cb3970204a for instance cae47769-02cd-4118-af46-0d3521ef7564 on user Apr 14 00:05:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Creating event network-vif-plugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:05:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104809 Apr 14 00:05:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107447 Apr 14 00:05:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 23/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:16 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 27/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:17 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-7cd94f89-334f-40c9-8798-f6e98ff8d439 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Action: 'create', calling method: .version_select at 0x7f3db76c0ca0>, body: {"keypair": {"name": "tempest-keypair-1602525381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlltbtWOxgngd+WOhM2SVJONWIntPB0ReceG24uuEnBxzOjgSZeKMIb99xQeMRz+3+GFOzCkntE3uvUQW5vCgDqEdtuSFgaUNPtz9CZS0JAX7xEqeTQ71l5QNHCs+vY7w=="}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:17 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-7cd94f89-334f-40c9-8798-f6e98ff8d439 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Getting quotas for project 293aba050c0e458a9d05bcbca5b49997. Resources: {'key_pairs'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:17 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-7cd94f89-334f-40c9-8798-f6e98ff8d439 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Getting quotas for user 6f81027ba772436092c0b317c3d5895d and project 293aba050c0e458a9d05bcbca5b49997. Resources: {'key_pairs'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:17 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-7cd94f89-334f-40c9-8798-f6e98ff8d439 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082606 Apr 14 00:05:17 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:05:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-plugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}, {"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Creating event network-vif-plugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:05:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:05:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088560 Apr 14 00:05:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 24/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1350015229", "imageRef": "24c53b8c-62a8-4f7f-91bc-0a2f07a14dae", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "4167bd9a-4666-4e4b-8b36-eea1ff220878"}], "security_groups": [{"name": "tempest-securitygroup--2086097937"}], "key_name": "tempest-keypair-1590246000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:19 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:19 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] validate_networks() for [('4167bd9a-4666-4e4b-8b36-eea1ff220878', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:05:20 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:20 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:20 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:20 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:20 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=15 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:20 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:05:20 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088299 Apr 14 00:05:20 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Getting quotas for project ccde4d67c2ed45af968e5f219cc8b6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Getting quotas for user b3bff58a90484c5db3f035ab1187080e and project ccde4d67c2ed45af968e5f219cc8b6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:05:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:05:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.026820 Apr 14 00:05:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 28/78] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:05:19 2023] POST /compute/v2.1/servers => generated 404 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:05:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-970523d9-7e76-4840-8569-8282cf684854 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:21 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-970523d9-7e76-4840-8569-8282cf684854 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:21 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:21 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=12 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:21 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-970523d9-7e76-4840-8569-8282cf684854 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bff58a90484c5db3f035ab1187080e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccde4d67c2ed45af968e5f219cc8b6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-970523d9-7e76-4840-8569-8282cf684854 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 200 len: 1240 microversion: 2.1 time: 0.228189 Apr 14 00:05:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 25/79] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:21 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:21 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1764639886", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "e63d7eb1-1787-415b-bfd6-963171b3a18f"}], "security_groups": [{"name": "tempest-securitygroup--847617696"}], "key_name": "tempest-keypair-1602525381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] validate_networks() for [('e63d7eb1-1787-415b-bfd6-963171b3a18f', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Getting quotas for project 293aba050c0e458a9d05bcbca5b49997. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Getting quotas for user 6f81027ba772436092c0b317c3d5895d and project 293aba050c0e458a9d05bcbca5b49997. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:05:22 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:05:22 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.035456 Apr 14 00:05:22 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 27/80] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:05:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:05:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-60a33c8f-270a-4f8c-96ee-ab685d310630 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:22 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-60a33c8f-270a-4f8c-96ee-ab685d310630 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:23 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-60a33c8f-270a-4f8c-96ee-ab685d310630 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81027ba772436092c0b317c3d5895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293aba050c0e458a9d05bcbca5b49997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-60a33c8f-270a-4f8c-96ee-ab685d310630 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" status: 200 len: 1226 microversion: 2.1 time: 0.201742 Apr 14 00:05:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 29/81] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:22 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => generated 1226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-353e1e3f-3508-4210-868d-189902ec488d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Action: 'create', calling method: .version_select at 0x7f3db6e856c0>, body: {"keypair": {"name": "tempest-keypair-2007231770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:25 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-353e1e3f-3508-4210-868d-189902ec488d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Getting quotas for project c4ee7b5626a14c69aefa86192b6e7bac. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:25 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-353e1e3f-3508-4210-868d-189902ec488d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Getting quotas for user 38f9a13bd3f74842b61b57b2ea8bf025 and project c4ee7b5626a14c69aefa86192b6e7bac. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-353e1e3f-3508-4210-868d-189902ec488d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.390065 Apr 14 00:05:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 26/82] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 00:05:25 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 392 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 14 00:05:26 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:26 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Creating event network-changed:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:05:26 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139246 Apr 14 00:05:26 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1428775386", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "281dc33c-0ea9-4812-97ed-82652b538fd0"}], "security_groups": [{"name": "tempest-securitygroup--429450847"}], "key_name": "tempest-keypair-2007231770", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=18 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Creating event network-changed:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:05:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038453 Apr 14 00:05:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 27/84] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:28 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] validate_networks() for [('281dc33c-0ea9-4812-97ed-82652b538fd0', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Getting quotas for project c4ee7b5626a14c69aefa86192b6e7bac. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Getting quotas for user 38f9a13bd3f74842b61b57b2ea8bf025 and project c4ee7b5626a14c69aefa86192b6e7bac. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:05:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:05:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 1.226929 Apr 14 00:05:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 30/85] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:05:28 2023] POST /compute/v2.1/servers => generated 403 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:05:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-75138103-5685-4beb-b802-678ab6a3abbf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:30 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-75138103-5685-4beb-b802-678ab6a3abbf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:30 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-75138103-5685-4beb-b802-678ab6a3abbf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:30 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-75138103-5685-4beb-b802-678ab6a3abbf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:30 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-75138103-5685-4beb-b802-678ab6a3abbf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-75138103-5685-4beb-b802-678ab6a3abbf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 200 len: 1321 microversion: 2.49 time: 0.234387 Apr 14 00:05:30 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 29/86] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:05:30 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:05:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "name": "network-vif-plugged", "status": "completed", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Creating event network-vif-plugged:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:05:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073074 Apr 14 00:05:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "name": "network-vif-plugged", "status": "completed", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:33 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=17 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Creating event network-vif-plugged:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:05:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115586 Apr 14 00:05:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 31/88] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:33 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:33 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "name": "network-vif-plugged", "status": "completed", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:33 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Creating event network-vif-plugged:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:05:33 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126827 Apr 14 00:05:33 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Creating event network-changed:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:05:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045502 Apr 14 00:05:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 29/90] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "name": "network-vif-plugged", "status": "completed", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Creating event network-vif-plugged:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:05:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041866 Apr 14 00:05:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 32/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:39 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-plugged", "status": "completed", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Creating event network-vif-plugged:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:05:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161053 Apr 14 00:05:39 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-plugged", "status": "completed", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Creating event network-vif-plugged:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:05:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063447 Apr 14 00:05:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 30/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=14 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=16 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:43 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:43 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:43 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f107b95b-9074-4c94-9b48-a5942d258a14 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 200 len: 1690 microversion: 2.87 time: 0.391950 Apr 14 00:05:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 33/94] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:05:42 2023] GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 1690 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:05:43 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457273b82bcb4fa6bbee81fdd9e0265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834d867e665a4671a901218d21fa8704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:43 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-46a7a4aa-a74c-4905-8afe-c230699dad53 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 200 len: 1489 microversion: 2.1 time: 0.646043 Apr 14 00:05:43 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:42 2023] GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 1489 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:44 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8552b35c-ce86-445b-8b81-20b6c82c68b2 tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Action: 'create', calling method: .version_select at 0x7f3db6e84310>, body: {"keypair": {"name": "tempest-keypair-1627073537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX8WGkRFH5ZwLe7ZLJLUr7AodRUuNmVsy59ME6MKR0NLl74nvof7OlfwNceqIH6eYUyoAg2DvvIZGb7PcZAT3VRaUwy4xBdCilmzOh8o3SExk05updM2Jbkaplex5CZ3g=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:44 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-8552b35c-ce86-445b-8b81-20b6c82c68b2 tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Getting quotas for project f8a7ace23ccb4c41b76a80532b3997b9. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:05:44 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-8552b35c-ce86-445b-8b81-20b6c82c68b2 tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Getting quotas for user f5613db231764f7c8c2ac461cf751d8e and project f8a7ace23ccb4c41b76a80532b3997b9. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:05:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8552b35c-ce86-445b-8b81-20b6c82c68b2 tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.086081 Apr 14 00:05:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 31/96] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 00:05:44 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:45 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-802bfac5-4843-4852-8fa1-a03d3a11bdee tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1554 microversion: 2.1 time: 0.283987 Apr 14 00:05:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 34/97] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:44 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1554 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:46 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1263962017", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "85976ef7-a561-41c7-828a-692f13d81a25"}, {"port": "939a4ab4-87f9-4ad1-bcd0-c35f71660c09", "tag": "port-1"}, {"port": "2410de68-423e-40ed-a80a-bc26062a2675", "tag": "port-2"}, {"uuid": "309f8474-d30d-4710-8b75-83ab15e20bad", "tag": "net-1"}, {"uuid": "309f8474-d30d-4710-8b75-83ab15e20bad"}, {"uuid": "19ac8ed7-449a-45fc-a928-6ad38d22852b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "19ac8ed7-449a-45fc-a928-6ad38d22852b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f1a3323a-058c-4e1d-8627-04fbfb2310bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c61b919a-21cb-438b-aa6a-9876ba06231d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "20a8a1b6-5d63-4d2b-b3b1-a642c0690120", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1026616364"}], "key_name": "tempest-keypair-1627073537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:05:46 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=5 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:46 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] validate_networks() for [('85976ef7-a561-41c7-828a-692f13d81a25', None, None, None, None, None), (None, None, '939a4ab4-87f9-4ad1-bcd0-c35f71660c09', None, None, None), (None, None, '2410de68-423e-40ed-a80a-bc26062a2675', None, None, None), ('309f8474-d30d-4710-8b75-83ab15e20bad', None, None, None, None, None), ('309f8474-d30d-4710-8b75-83ab15e20bad', None, None, None, None, None), ('19ac8ed7-449a-45fc-a928-6ad38d22852b', '10.2.2.100', None, None, None, None), ('19ac8ed7-449a-45fc-a928-6ad38d22852b', '10.2.2.200', None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-815f492a-fea4-4c89-8cbd-7a7997610501 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1585 microversion: 2.20 time: 0.321492 Apr 14 00:05:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 32/98] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:05:48 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1585 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:50 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-dcef49c9-a4f4-40ac-a376-da050752c393 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1534 microversion: 2.1 time: 0.182484 Apr 14 00:05:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 35/99] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:49 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1534 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=15 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:05:55 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:05:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ba722beb-f397-4742-9be8-c244c2cab937 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1539 microversion: 2.1 time: 0.249047 Apr 14 00:05:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 33/100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:05:55 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:05:57 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=21 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:11 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bff58a90484c5db3f035ab1187080e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccde4d67c2ed45af968e5f219cc8b6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-19c40670-3306-48cd-9e0a-596c28129845 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 200 len: 1550 microversion: 2.1 time: 0.164430 Apr 14 00:06:11 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 36/101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:06:11 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=20 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:13 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81027ba772436092c0b317c3d5895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293aba050c0e458a9d05bcbca5b49997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:13 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9374b0f7-723e-44bc-93f5-6ed3a98d66ed tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" status: 200 len: 1526 microversion: 2.1 time: 0.159461 Apr 14 00:06:13 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:06:13 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:06:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7c3ecfa8-7f8d-44da-92d2-d03595b3ed99 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Action: 'create', calling method: .version_select at 0x7f3db6e5e560>, body: {"keypair": {"name": "tempest-TestStampPattern-2105733066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:18 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-7c3ecfa8-7f8d-44da-92d2-d03595b3ed99 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting quotas for project 1f138770c7b4407d83c449500fc000a5. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:06:18 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-7c3ecfa8-7f8d-44da-92d2-d03595b3ed99 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting quotas for user 6fe75acb64a94a2a88d370f43fa6b776 and project 1f138770c7b4407d83c449500fc000a5. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:06:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7c3ecfa8-7f8d-44da-92d2-d03595b3ed99 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.221812 Apr 14 00:06:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 37/103] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:06:18 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:20 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4554a4e9-cdbf-4e65-8e2a-7a3f5f5dcf64 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 200 len: 1626 microversion: 2.49 time: 0.210443 Apr 14 00:06:20 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 35/104] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:06:20 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 1626 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:06:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-250370213", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "key_name": "tempest-TestStampPattern-2105733066", "security_groups": [{"name": "tempest-secgroup-smoke-954490873"}], "networks": [{"uuid": "f185dffe-f180-4107-8752-182e71fc07c1"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] validate_networks() for [('f185dffe-f180-4107-8752-182e71fc07c1', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting quotas for project 1f138770c7b4407d83c449500fc000a5. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting quotas for user 6fe75acb64a94a2a88d370f43fa6b776 and project 1f138770c7b4407d83c449500fc000a5. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:06:22 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:06:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.173628 Apr 14 00:06:22 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 38/105] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:06:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:06:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b698aa7f-5a9e-4fb5-a24d-73774f7c5c0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b698aa7f-5a9e-4fb5-a24d-73774f7c5c0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:22 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-b698aa7f-5a9e-4fb5-a24d-73774f7c5c0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b698aa7f-5a9e-4fb5-a24d-73774f7c5c0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465" status: 200 len: 1236 microversion: 2.1 time: 0.077173 Apr 14 00:06:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:06:22 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:06:25 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Creating event network-changed:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:06:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034691 Apr 14 00:06:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 39/107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "name": "network-vif-plugged", "status": "completed", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Creating event network-vif-plugged:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:06:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Apr 14 00:06:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "name": "network-vif-plugged", "status": "completed", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Creating event network-vif-plugged:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:06:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034650 Apr 14 00:06:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 40/109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=14 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1693944429"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc/action" status: 202 len: 52 microversion: 2.87 time: 1.581093 Apr 14 00:06:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 38/110] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:06:43 2023] POST /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc/action => generated 52 bytes in 1584 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=10 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f082e4a2-28c4-4983-a06e-a0785fd6b7c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.153718 Apr 14 00:06:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 41/111] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:06:45 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-interface => generated 283 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9751d47f-616e-4dc7-b5c5-910ddde3d0af"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3c3745dc-1e3d-4633-b56f-3afea2d4faf8 tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Calling method '.version_select at 0x7f3db6d01900>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3c3745dc-1e3d-4633-b56f-3afea2d4faf8 tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627073537" status: 204 len: 0 microversion: 2.32 time: 0.039362 Apr 14 00:06:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 42/112] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 00:06:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627073537 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:06:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.824972 Apr 14 00:06:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 39/113] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:06:46 2023] POST /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1381214436"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Creating event network-changed:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:06:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055141 Apr 14 00:06:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 43/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/action" status: 202 len: 0 microversion: 2.1 time: 1.565299 Apr 14 00:06:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 40/115] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:06:47 2023] POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/action => generated 0 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 00:06:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6bb1cf13-7a8e-4c28-889c-c1c49ebcb3f0 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '.version_select at 0x7f3db77de7a0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6bb1cf13-7a8e-4c28-889c-c1c49ebcb3f0 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1" status: 200 len: 1609 microversion: 2.1 time: 0.061006 Apr 14 00:06:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 44/116] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 00:06:48 2023] GET /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1 => generated 1609 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e13591e3-5e22-44fa-816c-0c3ba3b97f53 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.094620 Apr 14 00:06:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 41/117] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 00:06:49 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-25dc8aca-29c6-4865-a14f-06f25b79408c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.122173 Apr 14 00:06:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 45/118] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:06:50 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-interface => generated 282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Creating event network-changed:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:06:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Apr 14 00:06:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 46/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0be89923-adbb-4fbb-8124-4a91e5a0a022 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/ips" status: 200 len: 103 microversion: 2.1 time: 0.051195 Apr 14 00:06:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 47/120] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:06:51 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/ips => generated 103 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Creating event network-changed:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:06:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042704 Apr 14 00:06:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 48/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:51 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-37ef6589-ff09-4548-bdcb-04e43ba97bfe tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 200 len: 1703 microversion: 2.87 time: 0.369858 Apr 14 00:06:51 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 42/122] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:06:51 2023] GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 1703 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-88bfe450-215d-4492-a818-807d44203a95 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/ips" status: 200 len: 109 microversion: 2.20 time: 0.032401 Apr 14 00:06:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 49/123] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 00:06:51 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/ips => generated 109 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5021c122-fea0-4125-8b1f-c1ab3c4de5e7"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334956 Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 43/124] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:06:53 2023] POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:54 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'flavor' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:06:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/action" status: 202 len: 0 microversion: 2.20 time: 0.969209 Apr 14 00:06:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 50/125] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:06:54 2023] POST /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-74f8c698-b6ab-4f52-8377-26df840ab41e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1709 microversion: 2.20 time: 0.250459 Apr 14 00:06:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 44/126] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:06:55 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1709 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:06:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-unplugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Creating event network-vif-unplugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:06:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046736 Apr 14 00:06:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 51/127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-95cb771d-9e97-4fcd-bb44-3d2592b50b06 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.207118 Apr 14 00:06:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 45/128] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:06:55 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-interface => generated 282 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-plugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}, {"name": "network-changed", "server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Creating event network-vif-plugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:06:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Creating event network-changed:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:06:57 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039594 Apr 14 00:06:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 46/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:06:57 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:06:57 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8a6cb6ae-8054-404e-a09f-2ce71b6e9e96 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1539 microversion: 2.1 time: 0.229884 Apr 14 00:06:57 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 52/130] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:06:57 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1539 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:06:57 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:06:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-85dd68a6-8e70-4d66-b04a-9e46022d7fcc tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1539 microversion: 2.1 time: 0.339067 Apr 14 00:06:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 47/131] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:06:57 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:07:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 204 len: 0 microversion: 2.1 time: 0.138422 Apr 14 00:07:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 53/132] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:07:00 2023] DELETE /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457273b82bcb4fa6bbee81fdd9e0265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834d867e665a4671a901218d21fa8704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2702f727-6685-4b16-b2be-04fee4773f13 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 200 len: 1541 microversion: 2.1 time: 0.277257 Apr 14 00:07:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 48/133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:00 2023] GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 1541 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae47769-02cd-4118-af46-0d3521ef7564", "name": "network-vif-unplugged", "status": "completed", "tag": "43fb1710-4018-42d7-88ad-b5cb3970204a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Creating event network-vif-unplugged:43fb1710-4018-42d7-88ad-b5cb3970204a for instance cae47769-02cd-4118-af46-0d3521ef7564 on user Apr 14 00:07:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035233 Apr 14 00:07:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 54/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Creating event network-changed:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:07:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Apr 14 00:07:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 49/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:07:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Going to try to stop instance {{(pid=72774) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 00:07:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action" status: 202 len: 0 microversion: 2.1 time: 0.130498 Apr 14 00:07:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 55/136] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:07:01 2023] POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2b565f9c-dbb4-4c2e-bf19-2c83784f6ca2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1708 microversion: 2.1 time: 0.288887 Apr 14 00:07:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 50/137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:02 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1708 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae47769-02cd-4118-af46-0d3521ef7564", "name": "network-vif-plugged", "status": "completed", "tag": "43fb1710-4018-42d7-88ad-b5cb3970204a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Creating event network-vif-plugged:43fb1710-4018-42d7-88ad-b5cb3970204a for instance cae47769-02cd-4118-af46-0d3521ef7564 on user Apr 14 00:07:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055222 Apr 14 00:07:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 56/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae47769-02cd-4118-af46-0d3521ef7564", "name": "network-vif-deleted", "tag": "43fb1710-4018-42d7-88ad-b5cb3970204a"}, {"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-unplugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Creating event network-vif-deleted:43fb1710-4018-42d7-88ad-b5cb3970204a for instance cae47769-02cd-4118-af46-0d3521ef7564 on user Apr 14 00:07:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Creating event network-vif-unplugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:07:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.043433 Apr 14 00:07:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 51/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:02 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:04 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:07:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030685 Apr 14 00:07:04 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 57/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e0454f6e-350a-4ac3-9a9a-0afc37a1c199 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.103745 Apr 14 00:07:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 52/141] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:07:12 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:13 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8edf6222-88e4-4648-8c05-e857dee937ab tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465" status: 200 len: 1538 microversion: 2.1 time: 0.447591 Apr 14 00:07:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 58/142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:12 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 => generated 1538 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:13 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-decb3452-2c6a-4e78-8edf-8868dd6ab952 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.124846 Apr 14 00:07:13 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 53/143] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:07:13 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-interface => generated 283 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:13 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Creating event network-changed:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:07:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030023 Apr 14 00:07:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 59/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:14 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:14 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=35 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Creating event network-changed:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:07:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041462 Apr 14 00:07:14 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 54/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7267b8e-f20c-4625-b82d-b1a31a337714"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:14 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:14 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395614 Apr 14 00:07:14 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 60/146] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:07:14 2023] POST /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c69fa38-1485-41bd-922c-993c12dc3b53"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416644 Apr 14 00:07:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 55/147] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:07:15 2023] POST /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e004d690-b9a9-479b-a504-fdb4e4817169 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: .version_select at 0x7f3db6b39bd0>, body: {"keypair": {"name": "tempest-keypair-911498178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOVEOzN9EIzsoteVdO36ZxbbHQObkqlbYQQgZP7fHoK8FtNsMR54wb4Xcjl8NdjbV4Y1Ha6eHcMsgRwIH0Ep73QGv8X38xH2qztJvPxXuGkfTuWADRX823xouKZXmw7pw=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:18 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-e004d690-b9a9-479b-a504-fdb4e4817169 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:07:18 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-e004d690-b9a9-479b-a504-fdb4e4817169 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:07:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e004d690-b9a9-479b-a504-fdb4e4817169 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177551 Apr 14 00:07:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 61/148] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:07:18 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-614109817", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6d80f923-8aef-45df-921b-f77ed4ff0e75"}], "security_groups": [{"name": "tempest-securitygroup--889648312"}], "key_name": "tempest-keypair-911498178", "user_data": "}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] validate_networks() for [('6d80f923-8aef-45df-921b-f77ed4ff0e75', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0a1d0e6c-c894-41fe-a998-79061fba9932 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.113383 Apr 14 00:07:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 62/149] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 00:07:20 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-interface => generated 282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:07:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:07:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.676258 Apr 14 00:07:20 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 56/150] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:07:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e58640b1-bd35-4614-b31e-3821b1d1ce43 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e58640b1-bd35-4614-b31e-3821b1d1ce43 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e58640b1-bd35-4614-b31e-3821b1d1ce43 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e58640b1-bd35-4614-b31e-3821b1d1ce43 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 200 len: 1234 microversion: 2.1 time: 0.072986 Apr 14 00:07:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 63/151] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:20 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Creating event network-changed:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057961 Apr 14 00:07:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 57/152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8c94d605-1edf-4801-b1c4-c60b36578b01 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 200 len: 1626 microversion: 2.49 time: 0.284032 Apr 14 00:07:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 64/153] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:07:21 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 1626 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "tag": "nic-tag"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2024a461-c307-42e0-976a-bde8b1ef0bed"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments/c7267b8e-f20c-4625-b82d-b1a31a337714" status: 202 len: 0 microversion: 2.1 time: 0.574459 Apr 14 00:07:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 65/154] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 00:07:23 2023] PUT /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments/c7267b8e-f20c-4625-b82d-b1a31a337714 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Creating event network-changed:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:07:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030771 Apr 14 00:07:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 66/155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b4f921cf-7482-45e1-98cf-78928b480fcc tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052958 Apr 14 00:07:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 67/156] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:24 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "tag": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Creating event network-changed:8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038538 Apr 14 00:07:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 68/157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:24 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'services' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:07:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments/0c69fa38-1485-41bd-922c-993c12dc3b53" status: 202 len: 0 microversion: 2.1 time: 0.266284 Apr 14 00:07:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 69/158] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:07:24 2023] DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments/0c69fa38-1485-41bd-922c-993c12dc3b53 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:07:25 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-plugged", "status": "completed", "tag": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Creating event network-vif-plugged:8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039664 Apr 14 00:07:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 70/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:26 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-interface" status: 200 len: 283 microversion: 2.49 time: 4.187329 Apr 14 00:07:26 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 58/160] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 00:07:21 2023] POST /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-interface => generated 283 bytes in 4190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2509f860-ef4a-443f-9fc8-171e0df13a7a", "tag": "volume-tag"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.503198 Apr 14 00:07:26 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 71/161] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 00:07:26 2023] POST /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-5725a466-e709-4775-8d75-49a849ecebe2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074318 Apr 14 00:07:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 59/162] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:27 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3da6ccd5-8aeb-4d96-b766-3fcc0655a738 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063428 Apr 14 00:07:27 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 72/163] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:27 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "name": "network-vif-plugged", "status": "completed", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Creating event network-vif-plugged:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:07:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 Apr 14 00:07:27 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 73/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:07:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 204 len: 0 microversion: 2.1 time: 0.143771 Apr 14 00:07:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 60/165] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:07:27 2023] DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bff58a90484c5db3f035ab1187080e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccde4d67c2ed45af968e5f219cc8b6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3fb2d8ae-1279-4492-9f57-fd74fe0f7bf2 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 200 len: 1675 microversion: 2.1 time: 0.206657 Apr 14 00:07:27 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 74/166] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:27 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-plugged", "status": "completed", "tag": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Creating event network-vif-plugged:8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Apr 14 00:07:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 61/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "name": "network-vif-plugged", "status": "completed", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}, {"server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "name": "network-vif-deleted", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Creating event network-vif-plugged:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:07:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Creating event network-vif-deleted:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:07:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039206 Apr 14 00:07:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 75/168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "name": "network-vif-unplugged", "status": "completed", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}, {"server_uuid": "e97abae3-f573-48eb-a218-a8fec436ef3b", "name": "network-vif-plugged", "status": "completed", "tag": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Creating event network-vif-unplugged:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:07:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Creating event network-vif-plugged:28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance e97abae3-f573-48eb-a218-a8fec436ef3b on user Apr 14 00:07:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.099227 Apr 14 00:07:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 62/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:29 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:35 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'services' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:07:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-volume_attachments/2509f860-ef4a-443f-9fc8-171e0df13a7a" status: 202 len: 0 microversion: 2.49 time: 0.174785 Apr 14 00:07:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 76/170] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 00:07:35 2023] DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-volume_attachments/2509f860-ef4a-443f-9fc8-171e0df13a7a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-5958a63d-df0c-4be6-8a1f-a5a65c17f320 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077071 Apr 14 00:07:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 63/171] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:36 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-164896e7-76f3-45a2-b6e6-15f42b9eda80 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057340 Apr 14 00:07:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 77/172] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:36 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c7267b8e-f20c-4625-b82d-b1a31a337714"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments/2024a461-c307-42e0-976a-bde8b1ef0bed" status: 202 len: 0 microversion: 2.1 time: 0.345162 Apr 14 00:07:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 64/173] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 00:07:36 2023] PUT /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments/2024a461-c307-42e0-976a-bde8b1ef0bed => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:07:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-233bd4b0-bc89-4e3b-881a-0bedbaa6fd5c tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '.version_select at 0x7f3db6b39990>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-233bd4b0-bc89-4e3b-881a-0bedbaa6fd5c tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1" status: 200 len: 1723 microversion: 2.1 time: 0.071689 Apr 14 00:07:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 78/174] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 00:07:38 2023] GET /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1 => generated 1723 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96389101-4328-42b6-ab5d-f55369c0e994 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '.version_select at 0x7f3db6ca28c0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96389101-4328-42b6-ab5d-f55369c0e994 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1" status: 200 len: 1723 microversion: 2.1 time: 0.063717 Apr 14 00:07:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 65/175] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 00:07:38 2023] GET /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1 => generated 1723 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-51ce5572-9652-4a08-a996-507612ecf8df tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1673 microversion: 2.1 time: 0.180949 Apr 14 00:07:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 79/176] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:39 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-interface/8d5fc9ab-cbd3-46df-8389-c67fee40f75f" status: 202 len: 0 microversion: 2.49 time: 0.095392 Apr 14 00:07:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 66/177] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 00:07:39 2023] DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-interface/8d5fc9ab-cbd3-46df-8389-c67fee40f75f => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f256c3d5-6e4c-40d8-b0f1-4e49c1479594 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-instance-actions/req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7" status: 200 len: 474 microversion: 2.49 time: 0.269546 Apr 14 00:07:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 80/178] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 00:07:39 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-instance-actions/req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 => generated 474 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-unplugged", "status": "completed", "tag": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Creating event network-vif-unplugged:8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033541 Apr 14 00:07:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 67/179] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-deleted", "tag": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Creating event network-vif-deleted:8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Apr 14 00:07:40 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 81/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:41 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bd66abc9-a747-46e0-920c-7539d543d00e tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 200 len: 1690 microversion: 2.87 time: 0.180720 Apr 14 00:07:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 68/181] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:07:41 2023] GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:07:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-plugged", "status": "completed", "tag": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Creating event network-vif-plugged:8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:07:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033287 Apr 14 00:07:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 82/182] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:45 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-43fe109a-2305-422b-a902-cae51bdf4930 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1650 microversion: 2.20 time: 0.270762 Apr 14 00:07:45 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 69/183] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:07:45 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1650 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:48 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a2ffe4b6-4962-4051-aefe-6587fc86b265 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1658 microversion: 2.1 time: 0.225187 Apr 14 00:07:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 83/184] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:48 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1658 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:48 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-81d188cb-e864-493e-bcd3-033df40d76a3 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1658 microversion: 2.1 time: 0.164455 Apr 14 00:07:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 70/185] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:48 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1658 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-51681519-96b3-459e-97bd-1c71e3cfcae9 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Apr 14 00:07:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 84/186] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:50 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0e132c9a-a8aa-447b-809b-6716821e6e3f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Apr 14 00:07:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 71/187] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:50 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'services' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:07:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments/c7267b8e-f20c-4625-b82d-b1a31a337714" status: 202 len: 0 microversion: 2.1 time: 0.158009 Apr 14 00:07:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 85/188] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:07:50 2023] DELETE /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments/c7267b8e-f20c-4625-b82d-b1a31a337714 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] HTTP exception thrown: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Request method failure captured: Apr 14 00:07:50 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 HTTP/1.1 Apr 14 00:07:50 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:07:50 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:07:50 user devstack@n-api.service[72773]: Connection: close Apr 14 00:07:50 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:07:50 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:07:50 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:07:50 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:07:50 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJih0GCT8WHTC-Us8eD1MWtGXL_PG2yF41CPRJvEC53zQfi3lPzgO3bNIGUaGw8W79milRMODNTvH6peEAsenbhRPovLWCBfbKG4ctQTHSmeKY8ztFNdCjGHxLbR2RKTYqqG4YMqhrr2VzxhwLp7xnWcbn3vVwEtuuQsRduf0Ad0lLQ Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/834d867e665a4671a901218d21fa8704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Tenant: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Tenant-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Id: 457273b82bcb4fa6bbee81fdd9e0265c Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Name: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:50 user devstack@n-api.service[72773]: method: > Apr 14 00:07:50 user devstack@n-api.service[72773]: exception: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: action_args: {'id': 'cae47769-02cd-4118-af46-0d3521ef7564'} Apr 14 00:07:50 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Returning 404 to user: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:07:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6f0f7e82-7f3f-4671-be3d-ea6bbbe58551 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 404 len: 111 microversion: 2.1 time: 0.036587 Apr 14 00:07:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 72/189] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:50 2023] GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:07:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f7ad3ede-11fc-406d-99cc-b35204dd0eec tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041697 Apr 14 00:07:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 86/190] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:50 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] HTTP exception thrown: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Request method failure captured: Apr 14 00:07:50 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564/os-volume_attachments HTTP/1.1 Apr 14 00:07:50 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:07:50 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:07:50 user devstack@n-api.service[72773]: Connection: close Apr 14 00:07:50 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:07:50 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:07:50 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:07:50 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:07:50 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJih0GCT8WHTC-Us8eD1MWtGXL_PG2yF41CPRJvEC53zQfi3lPzgO3bNIGUaGw8W79milRMODNTvH6peEAsenbhRPovLWCBfbKG4ctQTHSmeKY8ztFNdCjGHxLbR2RKTYqqG4YMqhrr2VzxhwLp7xnWcbn3vVwEtuuQsRduf0Ad0lLQ Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Project-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/834d867e665a4671a901218d21fa8704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Tenant: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Tenant-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Id: 457273b82bcb4fa6bbee81fdd9e0265c Apr 14 00:07:50 user devstack@n-api.service[72773]: X-User-Name: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:50 user devstack@n-api.service[72773]: method: > Apr 14 00:07:50 user devstack@n-api.service[72773]: exception: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: action_args: {'server_id': 'cae47769-02cd-4118-af46-0d3521ef7564'} Apr 14 00:07:50 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:50 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Returning 404 to user: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:07:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-7d9f4e55-d747-43d1-a430-7fd958e9750d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030636 Apr 14 00:07:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 73/191] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:07:50 2023] GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:52 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:07:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c876f750-79ff-42eb-99f2-c93784063d71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1685 microversion: 2.1 time: 0.142845 Apr 14 00:07:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 87/192] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:52 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1685 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] HTTP exception thrown: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Request method failure captured: Apr 14 00:07:54 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 HTTP/1.1 Apr 14 00:07:54 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:07:54 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:07:54 user devstack@n-api.service[72773]: Connection: close Apr 14 00:07:54 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:07:54 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:07:54 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:07:54 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:07:54 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJih0GCT8WHTC-Us8eD1MWtGXL_PG2yF41CPRJvEC53zQfi3lPzgO3bNIGUaGw8W79milRMODNTvH6peEAsenbhRPovLWCBfbKG4ctQTHSmeKY8ztFNdCjGHxLbR2RKTYqqG4YMqhrr2VzxhwLp7xnWcbn3vVwEtuuQsRduf0Ad0lLQ Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Project-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Project-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/834d867e665a4671a901218d21fa8704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Tenant: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Tenant-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:54 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:54 user devstack@n-api.service[72773]: X-User: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:54 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:07:54 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:07:54 user devstack@n-api.service[72773]: X-User-Id: 457273b82bcb4fa6bbee81fdd9e0265c Apr 14 00:07:54 user devstack@n-api.service[72773]: X-User-Name: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:54 user devstack@n-api.service[72773]: method: > Apr 14 00:07:54 user devstack@n-api.service[72773]: exception: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72773]: action_args: {'id': 'cae47769-02cd-4118-af46-0d3521ef7564'} Apr 14 00:07:54 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Returning 404 to user: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:07:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ddb41c99-0886-4dc7-99bd-da3314748a75 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 404 len: 111 microversion: 2.1 time: 0.035238 Apr 14 00:07:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 74/193] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:07:54 2023] DELETE /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:07:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] HTTP exception thrown: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Request method failure captured: Apr 14 00:07:54 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 HTTP/1.1 Apr 14 00:07:54 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:07:54 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:07:54 user devstack@n-api.service[72774]: Connection: close Apr 14 00:07:54 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:07:54 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:07:54 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:07:54 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:07:54 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJih0GCT8WHTC-Us8eD1MWtGXL_PG2yF41CPRJvEC53zQfi3lPzgO3bNIGUaGw8W79milRMODNTvH6peEAsenbhRPovLWCBfbKG4ctQTHSmeKY8ztFNdCjGHxLbR2RKTYqqG4YMqhrr2VzxhwLp7xnWcbn3vVwEtuuQsRduf0Ad0lLQ Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Project-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Project-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/834d867e665a4671a901218d21fa8704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/834d867e665a4671a901218d21fa8704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Tenant: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Tenant-Id: 834d867e665a4671a901218d21fa8704 Apr 14 00:07:54 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-DeleteServersTestJSON-1615746799 Apr 14 00:07:54 user devstack@n-api.service[72774]: X-User: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:54 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:07:54 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:07:54 user devstack@n-api.service[72774]: X-User-Id: 457273b82bcb4fa6bbee81fdd9e0265c Apr 14 00:07:54 user devstack@n-api.service[72774]: X-User-Name: tempest-DeleteServersTestJSON-1615746799-project-member Apr 14 00:07:54 user devstack@n-api.service[72774]: method: > Apr 14 00:07:54 user devstack@n-api.service[72774]: exception: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72774]: action_args: {'id': 'cae47769-02cd-4118-af46-0d3521ef7564'} Apr 14 00:07:54 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. Apr 14 00:07:54 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:07:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Returning 404 to user: Instance cae47769-02cd-4118-af46-0d3521ef7564 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:07:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0180a3e1-7a69-4e4a-ae4a-e9c6039caf4c tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564" status: 404 len: 111 microversion: 2.1 time: 0.031075 Apr 14 00:07:54 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 88/194] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:07:54 2023] GET /compute/v2.1/servers/cae47769-02cd-4118-af46-0d3521ef7564 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:07:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f319456a-e933-415a-8e39-5acf5a6b028b tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Action: 'create', calling method: .version_select at 0x7f3db69a0310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1294893956"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:07:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f319456a-e933-415a-8e39-5acf5a6b028b tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.460556 Apr 14 00:07:59 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 75/195] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 00:07:58 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 462 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 00:07:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-91044993-2202-4050-80c0-2005b826b0ed tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db68b5360>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:07:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-91044993-2202-4050-80c0-2005b826b0ed tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 200 len: 345 microversion: 2.1 time: 0.051688 Apr 14 00:07:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 89/196] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:07:59 2023] GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c1ad6920-906d-423e-81bf-e821912f08f0 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6933910>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c1ad6920-906d-423e-81bf-e821912f08f0 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 200 len: 346 microversion: 2.1 time: 0.055828 Apr 14 00:08:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 76/197] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:08:00 2023] GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-191767a9-992f-490d-a4bf-02ee8778c699 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Action: 'create', calling method: .version_select at 0x7f3db68b5870>, body: {"snapshot": {"volume_id": "d58a4076-4b41-44ba-94a2-80a3f499cddc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-119620178"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-191767a9-992f-490d-a4bf-02ee8778c699 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.170029 Apr 14 00:08:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 90/198] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 00:08:00 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7bc14439-f119-47a8-a540-18328c396f70 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6bc5240>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-7bc14439-f119-47a8-a540-18328c396f70 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 200 len: 286 microversion: 2.1 time: 0.042928 Apr 14 00:08:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 77/199] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:00 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9ecd308d-ce81-4e4b-aa13-fcf234a6403b tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db68b67a0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9ecd308d-ce81-4e4b-aa13-fcf234a6403b tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040259 Apr 14 00:08:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 91/200] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 00:08:00 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8d0b29bb-3aaf-44ab-aaef-60009ea9bf01 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6b01750>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8d0b29bb-3aaf-44ab-aaef-60009ea9bf01 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 200 len: 286 microversion: 2.1 time: 0.035942 Apr 14 00:08:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 78/201] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:00 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a7446bb5-779e-4538-96f2-d1bd11865045 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6918a60>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a7446bb5-779e-4538-96f2-d1bd11865045 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 200 len: 286 microversion: 2.1 time: 0.033071 Apr 14 00:08:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 92/202] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:01 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6a4c4033-66c4-457f-83b4-2fdcd9895a56 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6bc6e60>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6a4c4033-66c4-457f-83b4-2fdcd9895a56 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 200 len: 287 microversion: 2.1 time: 0.036222 Apr 14 00:08:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 79/203] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:02 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a9397d0d-b560-4207-816b-821385635259 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db691be20>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a9397d0d-b560-4207-816b-821385635259 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 202 len: 0 microversion: 2.1 time: 0.119638 Apr 14 00:08:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 93/204] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 00:08:02 2023] DELETE /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 00:08:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b6220adb-d707-4161-945e-9d596e0bc820 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6b01f30>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b6220adb-d707-4161-945e-9d596e0bc820 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 200 len: 286 microversion: 2.1 time: 0.033097 Apr 14 00:08:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 80/205] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:02 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:03 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-49c6ceb8-115c-4de7-973e-742ba3a38f4a tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db68b7130>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-49c6ceb8-115c-4de7-973e-742ba3a38f4a tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 200 len: 286 microversion: 2.1 time: 0.035198 Apr 14 00:08:04 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 94/206] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:03 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:05 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=11 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:05 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:05 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bd60b142-113d-438d-b94f-d0c785ae50ad tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6933910>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-bd60b142-113d-438d-b94f-d0c785ae50ad tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] HTTP exception thrown: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. Apr 14 00:08:05 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bd60b142-113d-438d-b94f-d0c785ae50ad tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Request method failure captured: Apr 14 00:08:05 user devstack@n-api.service[72773]: request: GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce HTTP/1.1 Apr 14 00:08:05 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:05 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:05 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:05 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:08:05 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:05 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:05 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:05 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJleiDvVdukFEZUJ7WZhhi8UIxzI3YFt0wz4A1_OIWf92D768rILipuPL1WvdjEY9UwXsL7JBOreoGkfIoTMui2fcH3_pmkWke93vABQI6Cyz8HkbaxCTX_g0K2wZJxkAua3TzQqXiKca5DpmXU-XXRKUegce7Ppa3Z9CE_8g7Y_mmQ Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Project-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Tenant-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:05 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:05 user devstack@n-api.service[72773]: X-User: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:05 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:05 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:05 user devstack@n-api.service[72773]: X-User-Id: 8839de4e3e3b495b80006390ddd285a7 Apr 14 00:08:05 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:05 user devstack@n-api.service[72773]: method: Apr 14 00:08:05 user devstack@n-api.service[72773]: exception: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. Apr 14 00:08:05 user devstack@n-api.service[72773]: action_args: {'id': '622f5760-de05-4ce8-b760-992e7e7806ce'} Apr 14 00:08:05 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. (HTTP 404) (Request-ID: req-3d549358-58d9-4e81-a615-75e40e590fa0) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. Apr 14 00:08:05 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:05 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bd60b142-113d-438d-b94f-d0c785ae50ad tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Returning 404 to user: Snapshot 622f5760-de05-4ce8-b760-992e7e7806ce could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bd60b142-113d-438d-b94f-d0c785ae50ad tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce" status: 404 len: 111 microversion: 2.1 time: 0.055823 Apr 14 00:08:05 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 81/207] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:08:05 2023] GET /compute/v2.1/os-snapshots/622f5760-de05-4ce8-b760-992e7e7806ce => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:05 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=9 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:05 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db691b0a0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 202 len: 0 microversion: 2.1 time: 0.062754 Apr 14 00:08:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 95/208] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:08:05 2023] DELETE /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:08:05 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1f31ff4f-7ac0-4811-995f-b8fb3ce1a1c8 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db69a1c60>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1f31ff4f-7ac0-4811-995f-b8fb3ce1a1c8 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 200 len: 345 microversion: 2.1 time: 0.057260 Apr 14 00:08:05 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 82/209] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:08:05 2023] GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4407395d-5e3f-43ef-9a95-9a1ad8c53dcb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db691bac0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4407395d-5e3f-43ef-9a95-9a1ad8c53dcb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 200 len: 345 microversion: 2.1 time: 0.052146 Apr 14 00:08:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 96/210] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:08:06 2023] GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ad6142dd-619a-4cd5-9a19-44e1d7273575 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db69a1bd0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-ad6142dd-619a-4cd5-9a19-44e1d7273575 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] HTTP exception thrown: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ad6142dd-619a-4cd5-9a19-44e1d7273575 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Request method failure captured: Apr 14 00:08:07 user devstack@n-api.service[72773]: request: GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc HTTP/1.1 Apr 14 00:08:07 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:07 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:07 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:07 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:08:07 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:07 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:07 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:07 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJleiDvVdukFEZUJ7WZhhi8UIxzI3YFt0wz4A1_OIWf92D768rILipuPL1WvdjEY9UwXsL7JBOreoGkfIoTMui2fcH3_pmkWke93vABQI6Cyz8HkbaxCTX_g0K2wZJxkAua3TzQqXiKca5DpmXU-XXRKUegce7Ppa3Z9CE_8g7Y_mmQ Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Tenant-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Id: 8839de4e3e3b495b80006390ddd285a7 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:07 user devstack@n-api.service[72773]: method: Apr 14 00:08:07 user devstack@n-api.service[72773]: exception: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: action_args: {'id': 'd58a4076-4b41-44ba-94a2-80a3f499cddc'} Apr 14 00:08:07 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. (HTTP 404) (Request-ID: req-49a9ae58-608f-47e3-8991-6369fcf0d9be) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ad6142dd-619a-4cd5-9a19-44e1d7273575 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Returning 404 to user: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ad6142dd-619a-4cd5-9a19-44e1d7273575 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 404 len: 109 microversion: 2.1 time: 0.036675 Apr 14 00:08:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 83/211] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:08:07 2023] GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:07 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b59e7521-e05f-4d37-8748-d0b972688e74 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db69191b0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-b59e7521-e05f-4d37-8748-d0b972688e74 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] HTTP exception thrown: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b59e7521-e05f-4d37-8748-d0b972688e74 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Request method failure captured: Apr 14 00:08:07 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc HTTP/1.1 Apr 14 00:08:07 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:08:07 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:08:07 user devstack@n-api.service[72774]: Connection: close Apr 14 00:08:07 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:08:07 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:08:07 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:08:07 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:08:07 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJleiDvVdukFEZUJ7WZhhi8UIxzI3YFt0wz4A1_OIWf92D768rILipuPL1WvdjEY9UwXsL7JBOreoGkfIoTMui2fcH3_pmkWke93vABQI6Cyz8HkbaxCTX_g0K2wZJxkAua3TzQqXiKca5DpmXU-XXRKUegce7Ppa3Z9CE_8g7Y_mmQ Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Project-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Tenant-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:07 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72774]: X-User: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:07 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:08:07 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:08:07 user devstack@n-api.service[72774]: X-User-Id: 8839de4e3e3b495b80006390ddd285a7 Apr 14 00:08:07 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:07 user devstack@n-api.service[72774]: method: Apr 14 00:08:07 user devstack@n-api.service[72774]: exception: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72774]: action_args: {'id': 'd58a4076-4b41-44ba-94a2-80a3f499cddc'} Apr 14 00:08:07 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. (HTTP 404) (Request-ID: req-c4845d16-6d0b-4703-b2ac-a4c1e1f0afc0) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b59e7521-e05f-4d37-8748-d0b972688e74 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Returning 404 to user: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b59e7521-e05f-4d37-8748-d0b972688e74 tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 404 len: 109 microversion: 2.1 time: 0.036823 Apr 14 00:08:07 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 97/212] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:08:07 2023] DELETE /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c86d7324-c3ba-4f21-96c4-a747bce90cbb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Calling method '.version_select at 0x7f3db6933370>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-c86d7324-c3ba-4f21-96c4-a747bce90cbb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] HTTP exception thrown: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c86d7324-c3ba-4f21-96c4-a747bce90cbb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Request method failure captured: Apr 14 00:08:07 user devstack@n-api.service[72773]: request: GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc HTTP/1.1 Apr 14 00:08:07 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:07 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:07 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:07 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:08:07 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:07 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:07 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:07 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJleiDvVdukFEZUJ7WZhhi8UIxzI3YFt0wz4A1_OIWf92D768rILipuPL1WvdjEY9UwXsL7JBOreoGkfIoTMui2fcH3_pmkWke93vABQI6Cyz8HkbaxCTX_g0K2wZJxkAua3TzQqXiKca5DpmXU-XXRKUegce7Ppa3Z9CE_8g7Y_mmQ Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64f072d6b575417d9b584c527f345c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Tenant-Id: 64f072d6b575417d9b584c527f345c9e Apr 14 00:08:07 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170691329 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Id: 8839de4e3e3b495b80006390ddd285a7 Apr 14 00:08:07 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170691329-project-member Apr 14 00:08:07 user devstack@n-api.service[72773]: method: Apr 14 00:08:07 user devstack@n-api.service[72773]: exception: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: action_args: {'id': 'd58a4076-4b41-44ba-94a2-80a3f499cddc'} Apr 14 00:08:07 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. (HTTP 404) (Request-ID: req-5a2cda19-1f2e-477e-a04d-b5652c1d3daf) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. Apr 14 00:08:07 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c86d7324-c3ba-4f21-96c4-a747bce90cbb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] Returning 404 to user: Volume d58a4076-4b41-44ba-94a2-80a3f499cddc could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c86d7324-c3ba-4f21-96c4-a747bce90cbb tempest-VolumesSnapshotsTestJSON-170691329 tempest-VolumesSnapshotsTestJSON-170691329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc" status: 404 len: 109 microversion: 2.1 time: 0.036811 Apr 14 00:08:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 84/213] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:08:07 2023] GET /compute/v2.1/os-volumes/d58a4076-4b41-44ba-94a2-80a3f499cddc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-596034a5-d81f-4a46-b7c6-653e82046223 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Action: 'create', calling method: .version_select at 0x7f3db691acb0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-991277701", "metadata": {"Type": "work"}}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-596034a5-d81f-4a46-b7c6-653e82046223 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Request method failure captured: Apr 14 00:08:09 user devstack@n-api.service[72774]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 00:08:09 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:08:09 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:08:09 user devstack@n-api.service[72774]: Connection: close Apr 14 00:08:09 user devstack@n-api.service[72774]: Content-Length: 121 Apr 14 00:08:09 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:08:09 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:08:09 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:08:09 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJlorjOxQ3-LLHW8kVuT0LHGtCm_BAEzzmwjK4h5AQQ2zcZAoCy_qv7jmfxPiyVIY1fiHj1hNgGxydA3NbcK8gKK2C95wVjeZX4AY1apFblm2bUwJuidpAo0PFRqGYkFPm0w-QUXFxPhhfGEj0-dppivrJepeeauvHscl25rlJAdqsg Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Id: 087524c35ce74e879310dfb5f12c20ac Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72774]: Apr 14 00:08:09 user devstack@n-api.service[72774]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-991277701", "metadata": {"Type": "work"}}} Apr 14 00:08:09 user devstack@n-api.service[72774]: method: Apr 14 00:08:09 user devstack@n-api.service[72774]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-991277701', 'metadata': {'Type': 'work'}}}} Apr 14 00:08:09 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise error Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-596034a5-d81f-4a46-b7c6-653e82046223 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:09 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-596034a5-d81f-4a46-b7c6-653e82046223 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.174858 Apr 14 00:08:09 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 98/214] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 00:08:09 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3ba1b0a1-ac61-4592-a4b5-7516e0cd9208 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Action: 'create', calling method: .version_select at 0x7f3db6933880>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462078252", "metadata": {"Type": "work"}}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3ba1b0a1-ac61-4592-a4b5-7516e0cd9208 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Request method failure captured: Apr 14 00:08:09 user devstack@n-api.service[72773]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 00:08:09 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:09 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:09 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:09 user devstack@n-api.service[72773]: Content-Length: 120 Apr 14 00:08:09 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:09 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:09 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:09 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJlorjOxQ3-LLHW8kVuT0LHGtCm_BAEzzmwjK4h5AQQ2zcZAoCy_qv7jmfxPiyVIY1fiHj1hNgGxydA3NbcK8gKK2C95wVjeZX4AY1apFblm2bUwJuidpAo0PFRqGYkFPm0w-QUXFxPhhfGEj0-dppivrJepeeauvHscl25rlJAdqsg Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Id: 087524c35ce74e879310dfb5f12c20ac Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72773]: Apr 14 00:08:09 user devstack@n-api.service[72773]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462078252", "metadata": {"Type": "work"}}} Apr 14 00:08:09 user devstack@n-api.service[72773]: method: Apr 14 00:08:09 user devstack@n-api.service[72773]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 00:08:09 user devstack@n-api.service[72773]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1462078252', 'metadata': {'Type': 'work'}}}} Apr 14 00:08:09 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise error Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi '0' Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3ba1b0a1-ac61-4592-a4b5-7516e0cd9208 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3ba1b0a1-ac61-4592-a4b5-7516e0cd9208 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012295 Apr 14 00:08:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 85/215] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 00:08:09 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bc165856-75f3-4d27-9886-b2d21f269437 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Action: 'create', calling method: .version_select at 0x7f3db6740160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2063798538", "metadata": {"Type": "work"}}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bc165856-75f3-4d27-9886-b2d21f269437 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Request method failure captured: Apr 14 00:08:09 user devstack@n-api.service[72774]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 00:08:09 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:08:09 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:08:09 user devstack@n-api.service[72774]: Connection: close Apr 14 00:08:09 user devstack@n-api.service[72774]: Content-Length: 119 Apr 14 00:08:09 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:08:09 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:08:09 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:08:09 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJlorjOxQ3-LLHW8kVuT0LHGtCm_BAEzzmwjK4h5AQQ2zcZAoCy_qv7jmfxPiyVIY1fiHj1hNgGxydA3NbcK8gKK2C95wVjeZX4AY1apFblm2bUwJuidpAo0PFRqGYkFPm0w-QUXFxPhhfGEj0-dppivrJepeeauvHscl25rlJAdqsg Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Id: 087524c35ce74e879310dfb5f12c20ac Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72774]: Apr 14 00:08:09 user devstack@n-api.service[72774]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2063798538", "metadata": {"Type": "work"}}} Apr 14 00:08:09 user devstack@n-api.service[72774]: method: Apr 14 00:08:09 user devstack@n-api.service[72774]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2063798538', 'metadata': {'Type': 'work'}}}} Apr 14 00:08:09 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise error Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi '' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bc165856-75f3-4d27-9886-b2d21f269437 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:09 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-bc165856-75f3-4d27-9886-b2d21f269437 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008197 Apr 14 00:08:09 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 99/216] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 00:08:09 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-23772ca3-fc59-4de1-ac3c-8ca835e300c8 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Calling method '.version_select at 0x7f3db69a2290>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-23772ca3-fc59-4de1-ac3c-8ca835e300c8 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] HTTP exception thrown: Volume tempest-invalid-299869881 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-23772ca3-fc59-4de1-ac3c-8ca835e300c8 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Request method failure captured: Apr 14 00:08:09 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-299869881 HTTP/1.1 Apr 14 00:08:09 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:09 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:09 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:09 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:08:09 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:09 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:09 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:09 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJlorjOxQ3-LLHW8kVuT0LHGtCm_BAEzzmwjK4h5AQQ2zcZAoCy_qv7jmfxPiyVIY1fiHj1hNgGxydA3NbcK8gKK2C95wVjeZX4AY1apFblm2bUwJuidpAo0PFRqGYkFPm0w-QUXFxPhhfGEj0-dppivrJepeeauvHscl25rlJAdqsg Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Id: 087524c35ce74e879310dfb5f12c20ac Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72773]: method: Apr 14 00:08:09 user devstack@n-api.service[72773]: exception: Volume tempest-invalid-299869881 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: action_args: {'id': 'tempest-invalid-299869881'} Apr 14 00:08:09 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-299869881 could not be found. (HTTP 404) (Request-ID: req-c62eb732-f8ba-4b06-9e05-a41042cbd78c) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-299869881 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-299869881 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-299869881 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-23772ca3-fc59-4de1-ac3c-8ca835e300c8 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Returning 404 to user: Volume tempest-invalid-299869881 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-23772ca3-fc59-4de1-ac3c-8ca835e300c8 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-299869881" status: 404 len: 98 microversion: 2.1 time: 0.034229 Apr 14 00:08:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 86/217] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 00:08:09 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-299869881 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-59adf6be-32bc-40e1-90e6-a9f3cece17ae tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003360 Apr 14 00:08:09 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 100/218] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 00:08:09 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c89ebf92-b6f1-495e-9086-c0a198db4716 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004997 Apr 14 00:08:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 87/219] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 00:08:09 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ae2e60ee-5e62-4c40-b065-589a9bf43f6d tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Calling method '.version_select at 0x7f3db68b5000>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:09 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-ae2e60ee-5e62-4c40-b065-589a9bf43f6d tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] HTTP exception thrown: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ae2e60ee-5e62-4c40-b065-589a9bf43f6d tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Request method failure captured: Apr 14 00:08:09 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/os-volumes/7991d74f-5c01-434a-af93-fba9e66ca876 HTTP/1.1 Apr 14 00:08:09 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:08:09 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:08:09 user devstack@n-api.service[72774]: Connection: close Apr 14 00:08:09 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:08:09 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:08:09 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:08:09 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:08:09 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJlorjOxQ3-LLHW8kVuT0LHGtCm_BAEzzmwjK4h5AQQ2zcZAoCy_qv7jmfxPiyVIY1fiHj1hNgGxydA3NbcK8gKK2C95wVjeZX4AY1apFblm2bUwJuidpAo0PFRqGYkFPm0w-QUXFxPhhfGEj0-dppivrJepeeauvHscl25rlJAdqsg Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Id: 087524c35ce74e879310dfb5f12c20ac Apr 14 00:08:09 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72774]: method: Apr 14 00:08:09 user devstack@n-api.service[72774]: exception: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72774]: action_args: {'id': '7991d74f-5c01-434a-af93-fba9e66ca876'} Apr 14 00:08:09 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. (HTTP 404) (Request-ID: req-17ffb1fe-9e4b-40ce-aac6-d553fc54e62d) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ae2e60ee-5e62-4c40-b065-589a9bf43f6d tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Returning 404 to user: Volume 7991d74f-5c01-434a-af93-fba9e66ca876 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:09 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ae2e60ee-5e62-4c40-b065-589a9bf43f6d tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7991d74f-5c01-434a-af93-fba9e66ca876" status: 404 len: 109 microversion: 2.1 time: 0.033560 Apr 14 00:08:09 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 101/220] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:08:09 2023] DELETE /compute/v2.1/os-volumes/7991d74f-5c01-434a-af93-fba9e66ca876 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c80fc180-08f5-4f26-9833-b1f19a065ce5 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Calling method '.version_select at 0x7f3db69330a0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-c80fc180-08f5-4f26-9833-b1f19a065ce5 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] HTTP exception thrown: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c80fc180-08f5-4f26-9833-b1f19a065ce5 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Request method failure captured: Apr 14 00:08:09 user devstack@n-api.service[72773]: request: GET /compute/v2.1/os-volumes/ecc5550f-0683-473b-8782-ef958f559062 HTTP/1.1 Apr 14 00:08:09 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:09 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:09 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:09 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:08:09 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:09 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:09 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:09 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJlorjOxQ3-LLHW8kVuT0LHGtCm_BAEzzmwjK4h5AQQ2zcZAoCy_qv7jmfxPiyVIY1fiHj1hNgGxydA3NbcK8gKK2C95wVjeZX4AY1apFblm2bUwJuidpAo0PFRqGYkFPm0w-QUXFxPhhfGEj0-dppivrJepeeauvHscl25rlJAdqsg Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e23a3783abc6490c92b5d2cff6b55de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant-Id: e23a3783abc6490c92b5d2cff6b55de4 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesNegativeTest-1880064671 Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Id: 087524c35ce74e879310dfb5f12c20ac Apr 14 00:08:09 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesNegativeTest-1880064671-project-member Apr 14 00:08:09 user devstack@n-api.service[72773]: method: Apr 14 00:08:09 user devstack@n-api.service[72773]: exception: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: action_args: {'id': 'ecc5550f-0683-473b-8782-ef958f559062'} Apr 14 00:08:09 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. (HTTP 404) (Request-ID: req-2c927e13-6c89-4f06-ad65-1de279a5d068) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. Apr 14 00:08:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c80fc180-08f5-4f26-9833-b1f19a065ce5 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] Returning 404 to user: Volume ecc5550f-0683-473b-8782-ef958f559062 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c80fc180-08f5-4f26-9833-b1f19a065ce5 tempest-VolumesNegativeTest-1880064671 tempest-VolumesNegativeTest-1880064671-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ecc5550f-0683-473b-8782-ef958f559062" status: 404 len: 109 microversion: 2.1 time: 0.034343 Apr 14 00:08:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 88/221] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:08:09 2023] GET /compute/v2.1/os-volumes/ecc5550f-0683-473b-8782-ef958f559062 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:11 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ccdad7cb-b636-4a23-b88a-48e307b7f651 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 200 len: 1542 microversion: 2.1 time: 0.171891 Apr 14 00:08:11 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 102/222] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:11 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 1542 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:13 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:13 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ca4964da-fcef-4eb7-abd1-fadb6153c365 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465" status: 200 len: 1538 microversion: 2.1 time: 0.210812 Apr 14 00:08:13 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 89/223] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:13 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 => generated 1538 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:15 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Creating event network-changed:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:08:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038429 Apr 14 00:08:15 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 103/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e63ed78-ec07-4e8f-8ec4-e81494a415a3"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329746 Apr 14 00:08:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 90/225] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:08:15 2023] POST /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:17 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] HTTP exception thrown: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Request method failure captured: Apr 14 00:08:17 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b HTTP/1.1 Apr 14 00:08:17 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:08:17 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:08:17 user devstack@n-api.service[72774]: Connection: close Apr 14 00:08:17 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:08:17 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:08:17 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:08:17 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:08:17 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJilgMYfjowhhIe2hPrJbOYETEOEhnWUIaXMAcre4G3m5C3GgkYFSENgiiC3pPF68JdmcpBOumRsmhR3v62W8BQEPZDsjQzHYh9VEElTpEhSVlILpflNyMV-elUfTwZs6ORAXodXzMsUC51-XRUDYaf5EoFEWwNVktQ3y2agaEbwgdQ Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Project-Id: ccde4d67c2ed45af968e5f219cc8b6c2 Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Tenant-Id: ccde4d67c2ed45af968e5f219cc8b6c2 Apr 14 00:08:17 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:17 user devstack@n-api.service[72774]: X-User: tempest-AttachSCSIVolumeTestJSON-1907301903-project-member Apr 14 00:08:17 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:08:17 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:08:17 user devstack@n-api.service[72774]: X-User-Id: b3bff58a90484c5db3f035ab1187080e Apr 14 00:08:17 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1907301903-project-member Apr 14 00:08:17 user devstack@n-api.service[72774]: method: > Apr 14 00:08:17 user devstack@n-api.service[72774]: exception: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:17 user devstack@n-api.service[72774]: action_args: {'id': 'e97abae3-f573-48eb-a218-a8fec436ef3b'} Apr 14 00:08:17 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:17 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:17 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Returning 404 to user: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:17 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5c0c08c1-5607-421c-9fd1-b8fb43124715 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 404 len: 111 microversion: 2.1 time: 0.032484 Apr 14 00:08:17 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 104/226] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:17 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:17 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-febdccfa-af0b-4260-bdfd-0dba16634add tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '.version_select at 0x7f3db69a3d90>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-febdccfa-af0b-4260-bdfd-0dba16634add tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590246000" status: 202 len: 0 microversion: 2.1 time: 0.033696 Apr 14 00:08:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 91/227] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:08:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590246000 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] HTTP exception thrown: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Request method failure captured: Apr 14 00:08:22 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b HTTP/1.1 Apr 14 00:08:22 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:08:22 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:08:22 user devstack@n-api.service[72774]: Connection: close Apr 14 00:08:22 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:08:22 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:08:22 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:08:22 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:08:22 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJilgMYfjowhhIe2hPrJbOYETEOEhnWUIaXMAcre4G3m5C3GgkYFSENgiiC3pPF68JdmcpBOumRsmhR3v62W8BQEPZDsjQzHYh9VEElTpEhSVlILpflNyMV-elUfTwZs6ORAXodXzMsUC51-XRUDYaf5EoFEWwNVktQ3y2agaEbwgdQ Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Project-Id: ccde4d67c2ed45af968e5f219cc8b6c2 Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Tenant-Id: ccde4d67c2ed45af968e5f219cc8b6c2 Apr 14 00:08:22 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:22 user devstack@n-api.service[72774]: X-User: tempest-AttachSCSIVolumeTestJSON-1907301903-project-member Apr 14 00:08:22 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:08:22 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:08:22 user devstack@n-api.service[72774]: X-User-Id: b3bff58a90484c5db3f035ab1187080e Apr 14 00:08:22 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1907301903-project-member Apr 14 00:08:22 user devstack@n-api.service[72774]: method: > Apr 14 00:08:22 user devstack@n-api.service[72774]: exception: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72774]: action_args: {'id': 'e97abae3-f573-48eb-a218-a8fec436ef3b'} Apr 14 00:08:22 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Returning 404 to user: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e1d3d7aa-aff0-4de2-9ddf-eda3ca35c807 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 404 len: 111 microversion: 2.1 time: 0.037441 Apr 14 00:08:22 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 105/228] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:08:22 2023] DELETE /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] HTTP exception thrown: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Request method failure captured: Apr 14 00:08:22 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b HTTP/1.1 Apr 14 00:08:22 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:08:22 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:08:22 user devstack@n-api.service[72773]: Connection: close Apr 14 00:08:22 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:08:22 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:08:22 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:08:22 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:08:22 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJilgMYfjowhhIe2hPrJbOYETEOEhnWUIaXMAcre4G3m5C3GgkYFSENgiiC3pPF68JdmcpBOumRsmhR3v62W8BQEPZDsjQzHYh9VEElTpEhSVlILpflNyMV-elUfTwZs6ORAXodXzMsUC51-XRUDYaf5EoFEWwNVktQ3y2agaEbwgdQ Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Project-Id: ccde4d67c2ed45af968e5f219cc8b6c2 Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ccde4d67c2ed45af968e5f219cc8b6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Tenant-Id: ccde4d67c2ed45af968e5f219cc8b6c2 Apr 14 00:08:22 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1907301903 Apr 14 00:08:22 user devstack@n-api.service[72773]: X-User: tempest-AttachSCSIVolumeTestJSON-1907301903-project-member Apr 14 00:08:22 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:08:22 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:08:22 user devstack@n-api.service[72773]: X-User-Id: b3bff58a90484c5db3f035ab1187080e Apr 14 00:08:22 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1907301903-project-member Apr 14 00:08:22 user devstack@n-api.service[72773]: method: > Apr 14 00:08:22 user devstack@n-api.service[72773]: exception: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72773]: action_args: {'id': 'e97abae3-f573-48eb-a218-a8fec436ef3b'} Apr 14 00:08:22 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. Apr 14 00:08:22 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:08:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Returning 404 to user: Instance e97abae3-f573-48eb-a218-a8fec436ef3b could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:08:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8e68840b-790c-43ab-8621-57ea8c0d9b50 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b" status: 404 len: 111 microversion: 2.1 time: 0.037106 Apr 14 00:08:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 92/229] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:22 2023] GET /compute/v2.1/servers/e97abae3-f573-48eb-a218-a8fec436ef3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:25 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'services' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:08:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments/8e63ed78-ec07-4e8f-8ec4-e81494a415a3" status: 202 len: 0 microversion: 2.1 time: 0.205490 Apr 14 00:08:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 106/230] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:08:24 2023] DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments/8e63ed78-ec07-4e8f-8ec4-e81494a415a3 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-26fea256-6f1b-491a-8733-471b2a48342b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052582 Apr 14 00:08:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 93/231] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:08:25 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1531683904", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] validate_networks() for [('582cbaa2-4fc5-49e5-95d1-fe2749e7c842', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Getting quotas for project 8d713f06b1714ade81068ed4f9edd035. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Getting quotas for user f6564746aecb479c8e408df9600222cb and project 8d713f06b1714ade81068ed4f9edd035. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:08:26 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:08:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.766723 Apr 14 00:08:26 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 107/232] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:08:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:08:26 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-50ae2f72-4b90-4bce-8570-f7334d509b48 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:26 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-50ae2f72-4b90-4bce-8570-f7334d509b48 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:26 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-50ae2f72-4b90-4bce-8570-f7334d509b48 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6564746aecb479c8e408df9600222cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d713f06b1714ade81068ed4f9edd035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:26 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-50ae2f72-4b90-4bce-8570-f7334d509b48 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8" status: 200 len: 1208 microversion: 2.1 time: 0.071236 Apr 14 00:08:26 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 94/233] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:26 2023] GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8 => generated 1208 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db291c2f-a72c-46ce-8de8-3956de37ccf8", "tag": "8916fec3-211a-470f-b70f-8a73690d3466"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Creating event network-changed:8916fec3-211a-470f-b70f-8a73690d3466 for instance db291c2f-a72c-46ce-8de8-3956de37ccf8 on user Apr 14 00:08:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032384 Apr 14 00:08:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 108/234] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a89332a6-63b0-4c06-a46c-277012b026c6 tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-instance-actions/req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7" status: 200 len: 503 microversion: 2.49 time: 0.086260 Apr 14 00:08:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 95/235] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 00:08:29 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-instance-actions/req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 => generated 503 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3252aacd-2ee5-4e7e-9c80-251fc511368e tempest-TaggedAttachmentsTest-2134542519 tempest-TaggedAttachmentsTest-2134542519-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-instance-actions/req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7" status: 200 len: 503 microversion: 2.49 time: 0.043106 Apr 14 00:08:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 109/236] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 00:08:29 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-instance-actions/req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 => generated 503 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-32a69a57-d187-4800-9d82-e57ca95fdb97 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.042823 Apr 14 00:08:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 96/237] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 00:08:29 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:30 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:08:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 204 len: 0 microversion: 2.49 time: 0.117874 Apr 14 00:08:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 110/238] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:08:29 2023] DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-83de2846-5b81-44af-ba75-762aa9d288c1 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 200 len: 1751 microversion: 2.49 time: 0.205986 Apr 14 00:08:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 97/239] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:08:30 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:08:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-unplugged", "status": "completed", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Creating event network-vif-unplugged:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:08:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028010 Apr 14 00:08:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 111/240] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-plugged", "status": "completed", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Creating event network-vif-plugged:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:08:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052958 Apr 14 00:08:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 98/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db291c2f-a72c-46ce-8de8-3956de37ccf8", "name": "network-vif-plugged", "status": "completed", "tag": "8916fec3-211a-470f-b70f-8a73690d3466"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Creating event network-vif-plugged:8916fec3-211a-470f-b70f-8a73690d3466 for instance db291c2f-a72c-46ce-8de8-3956de37ccf8 on user Apr 14 00:08:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039994 Apr 14 00:08:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 112/242] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff", "name": "network-vif-deleted", "tag": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f"}, {"server_uuid": "db291c2f-a72c-46ce-8de8-3956de37ccf8", "name": "network-vif-plugged", "status": "completed", "tag": "8916fec3-211a-470f-b70f-8a73690d3466"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Creating event network-vif-deleted:dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff on user Apr 14 00:08:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Creating event network-vif-plugged:8916fec3-211a-470f-b70f-8a73690d3466 for instance db291c2f-a72c-46ce-8de8-3956de37ccf8 on user Apr 14 00:08:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082329 Apr 14 00:08:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 99/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:39 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5b5f4324-725e-41b3-8f0b-e5bd5201e032 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1673 microversion: 2.1 time: 0.206893 Apr 14 00:08:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 113/244] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:39 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1673 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-704f0d3e-d20e-46d9-87b6-73f679197bb7 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064503 Apr 14 00:08:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 100/245] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:08:40 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:08:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" status: 204 len: 0 microversion: 2.1 time: 0.146647 Apr 14 00:08:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 114/246] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:08:40 2023] DELETE /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f81027ba772436092c0b317c3d5895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293aba050c0e458a9d05bcbca5b49997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1f140923-5c05-4953-bbc1-f42d821272b0 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" status: 200 len: 1651 microversion: 2.1 time: 0.357748 Apr 14 00:08:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 101/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:41 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => generated 1651 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "name": "network-vif-unplugged", "status": "completed", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Creating event network-vif-unplugged:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:08:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059823 Apr 14 00:08:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 115/248] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1240439258", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "491696ea-38ef-4c19-9d94-a61223c1fa00"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] validate_networks() for [('491696ea-38ef-4c19-9d94-a61223c1fa00', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "028eff5c-aa61-4243-985e-5210aedff04a"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330570 Apr 14 00:08:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 116/249] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:08:42 2023] POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for user 90bad96535c3453792982c5acab9dbc6 and project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:08:42 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:08:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.857021 Apr 14 00:08:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 102/250] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:08:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7baa8cc4-a289-4628-8558-eec204a62e74 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7baa8cc4-a289-4628-8558-eec204a62e74 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7baa8cc4-a289-4628-8558-eec204a62e74 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7baa8cc4-a289-4628-8558-eec204a62e74 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:42 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7baa8cc4-a289-4628-8558-eec204a62e74 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7baa8cc4-a289-4628-8558-eec204a62e74 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1395 microversion: 2.87 time: 0.108127 Apr 14 00:08:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 117/251] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:08:42 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1395 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:08:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "name": "network-vif-deleted", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] Creating event network-vif-deleted:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:08:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039522 Apr 14 00:08:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 103/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "name": "network-vif-plugged", "status": "completed", "tag": "e8376395-8a3e-46bf-a137-3e740e4e70ef"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Creating event network-vif-plugged:e8376395-8a3e-46bf-a137-3e740e4e70ef for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 on user Apr 14 00:08:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044183 Apr 14 00:08:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 118/253] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af1b05d2-717a-489c-8bdf-160d00ebd122"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Creating event network-changed:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059586 Apr 14 00:08:45 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 104/254] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-24a55530-5fff-4a7b-aeb5-d0c4bbd0566e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.384921 Apr 14 00:08:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 119/255] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 00:08:45 2023] POST /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments => generated 188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72773) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 00:08:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/action" status: 202 len: 0 microversion: 2.20 time: 0.233130 Apr 14 00:08:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 105/256] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:08:46 2023] POST /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-cd526261-04ab-44d8-a2c6-3aa9ca8e6009 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Action: 'create', calling method: .version_select at 0x7f3db691b7f0>, body: {"keypair": {"name": "tempest-keypair-1912277882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzgAnzYZDrHRSOtHVv/zz9Jq59yqHCgj+XUAspYSe7CuNpSWviw5YD7t1g/w4+Yy6KXGWPMGPWkh09BzPQ7qv26QIE2Xeb9uqZ1VE97Ta+wjygIDmM6CU+6ySBTktY5UA=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:46 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-cd526261-04ab-44d8-a2c6-3aa9ca8e6009 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting quotas for project dffbe999e60a4add9f23c83f9b0a4252. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:08:46 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-cd526261-04ab-44d8-a2c6-3aa9ca8e6009 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting quotas for user 74d7e3d598e74c288e6a44996303b85e and project dffbe999e60a4add9f23c83f9b0a4252. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:08:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-cd526261-04ab-44d8-a2c6-3aa9ca8e6009 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.242309 Apr 14 00:08:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 120/257] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:08:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:46 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8a738d96-7013-45d1-9ba8-8534f4fd106c tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1736 microversion: 2.20 time: 0.262292 Apr 14 00:08:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 106/258] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:08:46 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 00:08:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1922236850", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a"}], "security_groups": [{"name": "tempest-securitygroup--1637270708"}], "key_name": "tempest-keypair-1912277882", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:48 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] validate_networks() for [('49f71fbc-7d65-4cc6-9efe-3918d5dbd51a', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting quotas for project dffbe999e60a4add9f23c83f9b0a4252. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting quotas for user 74d7e3d598e74c288e6a44996303b85e and project dffbe999e60a4add9f23c83f9b0a4252. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:08:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.639286 Apr 14 00:08:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 121/259] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:08:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:08:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8e7a9dd4-0dc6-4298-a212-2507a4204c92 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8e7a9dd4-0dc6-4298-a212-2507a4204c92 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8e7a9dd4-0dc6-4298-a212-2507a4204c92 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8e7a9dd4-0dc6-4298-a212-2507a4204c92 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05" status: 200 len: 1236 microversion: 2.1 time: 0.069973 Apr 14 00:08:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 107/260] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:49 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4ccdade0-5f9b-4dd0-b5bf-ca189ed09716 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1658 microversion: 2.1 time: 0.168178 Apr 14 00:08:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 122/261] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:49 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1658 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49172d5a-2944-486a-a080-04548e55ac0d"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "b55f3d04-4ac0-4525-8efe-35fed088afe1"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:50 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'flavor' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:08:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489209 Apr 14 00:08:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 108/262] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:08:50 2023] POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/action" status: 200 len: 29 microversion: 2.1 time: 0.547972 Apr 14 00:08:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 123/263] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:08:50 2023] POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/action => generated 29 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:51 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4f02feef-15eb-4403-8b8b-c1849d7c6caa tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1725 microversion: 2.1 time: 0.362818 Apr 14 00:08:51 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 109/264] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:51 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-unplugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Creating event network-vif-unplugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:08:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047397 Apr 14 00:08:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 124/265] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Creating event network-changed:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:08:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036374 Apr 14 00:08:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 110/266] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Going to try to start instance {{(pid=72774) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 00:08:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=11,nova_cell1:INSERT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action" status: 202 len: 0 microversion: 2.1 time: 0.097837 Apr 14 00:08:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 125/267] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:08:52 2023] POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:53 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:08:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0b8e9bff-8def-4f1f-af32-35d008784ca8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1694 microversion: 2.1 time: 0.214752 Apr 14 00:08:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 111/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:08:52 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:08:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:08:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042858 Apr 14 00:08:54 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 126/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Creating event network-changed:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:08:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035809 Apr 14 00:08:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 112/270] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "name": "network-vif-plugged", "status": "completed", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Creating event network-vif-plugged:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:08:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028878 Apr 14 00:08:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 127/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "name": "network-vif-plugged", "status": "completed", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}, {"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}, {"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Creating event network-vif-plugged:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:08:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:08:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:08:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044293 Apr 14 00:08:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 113/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:58 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:08:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:08:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:08:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:08:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:08:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:08:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099856 Apr 14 00:08:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 128/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:09:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072959 Apr 14 00:09:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 114/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:01 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:01 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=12 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:09:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060485 Apr 14 00:09:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 129/275] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-823f934b-18bf-4fa1-bbfa-386346401f49 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1704 microversion: 2.1 time: 0.243697 Apr 14 00:09:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 115/276] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:02 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1704 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1662090424", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: dict_keys(['metadata_items']) {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: dict_keys(['metadata_items']) {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/action" status: 202 len: 1160 microversion: 2.1 time: 0.421369 Apr 14 00:09:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 130/277] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 00:09:02 2023] POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/action => generated 1160 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:02 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6c085135-09be-40a5-baa6-8167e98e379c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1732 microversion: 2.1 time: 0.191223 Apr 14 00:09:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 116/278] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:02 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:03 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-unplugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Creating event network-vif-unplugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:09:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038884 Apr 14 00:09:03 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 131/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:09:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038498 Apr 14 00:09:03 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 117/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}, {"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-plugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}, {"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-plugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:09:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Creating event network-vif-plugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:09:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Creating event network-vif-plugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:09:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042910 Apr 14 00:09:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 132/281] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:11 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:11 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-07b91374-2b19-4e3f-b164-caebbd18e177 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.159580 Apr 14 00:09:11 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 118/282] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:09:11 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:09:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:12 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Creating event network-changed:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:09:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062841 Apr 14 00:09:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 133/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-493334aa-ba21-49cb-aac3-9b0af5a165d2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/ips" status: 200 len: 107 microversion: 2.1 time: 0.049726 Apr 14 00:09:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 119/284] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:09:12 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/ips => generated 107 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ba2057-0822-4741-b91d-718067f21593"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340758 Apr 14 00:09:15 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 134/285] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:09:14 2023] POST /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0192ac25-54ba-4c68-b904-468d9bd2fd5b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055056 Apr 14 00:09:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 120/286] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:09:15 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:09:16 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:09:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052046 Apr 14 00:09:16 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 135/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:17 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6564746aecb479c8e408df9600222cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d713f06b1714ade81068ed4f9edd035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:17 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-53f61811-2aae-4c8f-92cf-a5f37b593f7b tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8" status: 200 len: 1486 microversion: 2.1 time: 0.303429 Apr 14 00:09:17 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 121/288] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:16 2023] GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8 => generated 1486 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:09:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053390 Apr 14 00:09:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 136/289] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-845995898"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/action" status: 202 len: 0 microversion: 2.1 time: 1.066082 Apr 14 00:09:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 122/290] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:09:18 2023] POST /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/action => generated 0 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] HTTP exception thrown: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Request method failure captured: Apr 14 00:09:20 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff HTTP/1.1 Apr 14 00:09:20 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:09:20 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:09:20 user devstack@n-api.service[72774]: Connection: close Apr 14 00:09:20 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:09:20 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:09:20 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:09:20 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:09:20 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJisFwOkMrSJBs9DRZFcmZ4ViwZkGANB9FEVsIWZugg7EYrym98CdIFTD0mXzSEeDsoGTlFEmtWpoJfOelQMvmEpuabH-zE83b07ncvOL6FIJ4A4DQjUpzWodc-Qgi2thVt7gFOUYr3PgWketrP7uGUKHLJy7URp_Oi2pDAVuQsUIqM Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Project-Id: c4ee7b5626a14c69aefa86192b6e7bac Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Project-Name: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Tenant: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Tenant-Id: c4ee7b5626a14c69aefa86192b6e7bac Apr 14 00:09:20 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:20 user devstack@n-api.service[72774]: X-User: tempest-TaggedAttachmentsTest-694590407-project-member Apr 14 00:09:20 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:09:20 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:09:20 user devstack@n-api.service[72774]: X-User-Id: 38f9a13bd3f74842b61b57b2ea8bf025 Apr 14 00:09:20 user devstack@n-api.service[72774]: X-User-Name: tempest-TaggedAttachmentsTest-694590407-project-member Apr 14 00:09:20 user devstack@n-api.service[72774]: method: > Apr 14 00:09:20 user devstack@n-api.service[72774]: exception: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:20 user devstack@n-api.service[72774]: action_args: {'id': 'b9c6323b-ed7f-4f86-93ad-3ef4726b01ff'} Apr 14 00:09:20 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Returning 404 to user: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:09:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1203c786-0a85-41d8-840b-dac86e8dcfb6 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 404 len: 111 microversion: 2.49 time: 0.052869 Apr 14 00:09:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 137/291] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:09:20 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:09:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1c05762a-c7ec-4f72-86aa-dae43465ca70 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '.version_select at 0x7f3db683a320>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1c05762a-c7ec-4f72-86aa-dae43465ca70 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007231770" status: 204 len: 0 microversion: 2.49 time: 0.027447 Apr 14 00:09:20 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 123/292] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 00:09:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007231770 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=4,nova_cell1:UPDATE=6,nova_cell1:DELETE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] HTTP exception thrown: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Request method failure captured: Apr 14 00:09:23 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff HTTP/1.1 Apr 14 00:09:23 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:09:23 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:09:23 user devstack@n-api.service[72774]: Connection: close Apr 14 00:09:23 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:09:23 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:09:23 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:09:23 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:09:23 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJisFwOkMrSJBs9DRZFcmZ4ViwZkGANB9FEVsIWZugg7EYrym98CdIFTD0mXzSEeDsoGTlFEmtWpoJfOelQMvmEpuabH-zE83b07ncvOL6FIJ4A4DQjUpzWodc-Qgi2thVt7gFOUYr3PgWketrP7uGUKHLJy7URp_Oi2pDAVuQsUIqM Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Project-Id: c4ee7b5626a14c69aefa86192b6e7bac Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Project-Name: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Tenant: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Tenant-Id: c4ee7b5626a14c69aefa86192b6e7bac Apr 14 00:09:23 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:23 user devstack@n-api.service[72774]: X-User: tempest-TaggedAttachmentsTest-694590407-project-member Apr 14 00:09:23 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:09:23 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:09:23 user devstack@n-api.service[72774]: X-User-Id: 38f9a13bd3f74842b61b57b2ea8bf025 Apr 14 00:09:23 user devstack@n-api.service[72774]: X-User-Name: tempest-TaggedAttachmentsTest-694590407-project-member Apr 14 00:09:23 user devstack@n-api.service[72774]: method: > Apr 14 00:09:23 user devstack@n-api.service[72774]: exception: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72774]: action_args: {'id': 'b9c6323b-ed7f-4f86-93ad-3ef4726b01ff'} Apr 14 00:09:23 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Returning 404 to user: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:09:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3d1549dc-f0c6-4cab-bab3-881d9bef9672 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 404 len: 111 microversion: 2.49 time: 0.037773 Apr 14 00:09:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 138/293] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:09:23 2023] DELETE /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] HTTP exception thrown: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Request method failure captured: Apr 14 00:09:23 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff HTTP/1.1 Apr 14 00:09:23 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:09:23 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:09:23 user devstack@n-api.service[72773]: Connection: close Apr 14 00:09:23 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:09:23 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:09:23 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:09:23 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:09:23 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJisFwOkMrSJBs9DRZFcmZ4ViwZkGANB9FEVsIWZugg7EYrym98CdIFTD0mXzSEeDsoGTlFEmtWpoJfOelQMvmEpuabH-zE83b07ncvOL6FIJ4A4DQjUpzWodc-Qgi2thVt7gFOUYr3PgWketrP7uGUKHLJy7URp_Oi2pDAVuQsUIqM Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Project-Id: c4ee7b5626a14c69aefa86192b6e7bac Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Project-Name: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4ee7b5626a14c69aefa86192b6e7bac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Tenant: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Tenant-Id: c4ee7b5626a14c69aefa86192b6e7bac Apr 14 00:09:23 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TaggedAttachmentsTest-694590407 Apr 14 00:09:23 user devstack@n-api.service[72773]: X-User: tempest-TaggedAttachmentsTest-694590407-project-member Apr 14 00:09:23 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:09:23 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:09:23 user devstack@n-api.service[72773]: X-User-Id: 38f9a13bd3f74842b61b57b2ea8bf025 Apr 14 00:09:23 user devstack@n-api.service[72773]: X-User-Name: tempest-TaggedAttachmentsTest-694590407-project-member Apr 14 00:09:23 user devstack@n-api.service[72773]: method: > Apr 14 00:09:23 user devstack@n-api.service[72773]: exception: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72773]: action_args: {'id': 'b9c6323b-ed7f-4f86-93ad-3ef4726b01ff'} Apr 14 00:09:23 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. Apr 14 00:09:23 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:09:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Returning 404 to user: Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:09:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e79771b3-d283-4907-bc39-567f54b0b39d tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" status: 404 len: 111 microversion: 2.49 time: 0.045337 Apr 14 00:09:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 124/294] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:09:23 2023] GET /compute/v2.1/servers/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:09:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d829b19f-754f-464d-9a32-a49f130b5143 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: .version_select at 0x7f3db691b9a0>, body: {"keypair": {"name": "tempest-keypair-1420639753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeiJtJCQqS2PvzHgPRX8caDhL22zKM9Gv3U+QC2mkpW6/QtmgBvpNWlwmqo9c3rbYg77B6fYlhGNUJOqzhSxMkT9Q7v/DdYFlQ5yKVzmqfTbNnCeI9BKbmpVv6CfIRkSg=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:24 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-d829b19f-754f-464d-9a32-a49f130b5143 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:09:24 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-d829b19f-754f-464d-9a32-a49f130b5143 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:09:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d829b19f-754f-464d-9a32-a49f130b5143 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052502 Apr 14 00:09:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 139/295] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:09:24 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-679422627", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6d80f923-8aef-45df-921b-f77ed4ff0e75"}], "security_groups": [{"name": "tempest-securitygroup--1329516092"}], "key_name": "tempest-keypair-1420639753", "user_data": "}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] validate_networks() for [('6d80f923-8aef-45df-921b-f77ed4ff0e75', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:09:26 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:09:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.797134 Apr 14 00:09:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 125/296] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:09:26 2023] POST /compute/v2.1/servers => generated 400 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:09:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-09bf2f3a-5713-4b2b-83f1-c473ed2eb86a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-09bf2f3a-5713-4b2b-83f1-c473ed2eb86a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:27 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-09bf2f3a-5713-4b2b-83f1-c473ed2eb86a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-09bf2f3a-5713-4b2b-83f1-c473ed2eb86a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 200 len: 1235 microversion: 2.1 time: 0.081292 Apr 14 00:09:27 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 140/297] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:27 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:09:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1199162286", "imageRef": "16275777-e8d4-4654-a571-dc2e6d715cf8", "flavorRef": "42", "key_name": "tempest-TestStampPattern-2105733066", "security_groups": [{"name": "tempest-secgroup-smoke-954490873"}], "networks": [{"uuid": "f185dffe-f180-4107-8752-182e71fc07c1"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] validate_networks() for [('f185dffe-f180-4107-8752-182e71fc07c1', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting quotas for project 1f138770c7b4407d83c449500fc000a5. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting quotas for user 6fe75acb64a94a2a88d370f43fa6b776 and project 1f138770c7b4407d83c449500fc000a5. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:09:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='16275777-e8d4-4654-a571-dc2e6d715cf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:09:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.919178 Apr 14 00:09:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 126/298] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:09:28 2023] POST /compute/v2.1/servers => generated 403 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:09:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a760b0e0-bd3a-4f3a-8096-6c091bdad7f7 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a760b0e0-bd3a-4f3a-8096-6c091bdad7f7 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:30 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-a760b0e0-bd3a-4f3a-8096-6c091bdad7f7 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a760b0e0-bd3a-4f3a-8096-6c091bdad7f7 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" status: 200 len: 1237 microversion: 2.1 time: 0.147244 Apr 14 00:09:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 141/299] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:29 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Creating event network-changed:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:09:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038605 Apr 14 00:09:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 127/300] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] HTTP exception thrown: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Request method failure captured: Apr 14 00:09:31 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 HTTP/1.1 Apr 14 00:09:31 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:09:31 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:09:31 user devstack@n-api.service[72774]: Connection: close Apr 14 00:09:31 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:09:31 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:09:31 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:09:31 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:09:31 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJioaXexoYUSEZ51VLbCnM9CLKtSC7Vf3-ZMiYtcluZw2NFZiNwDBE33Gi-GbFjgHUefVnidUaroGjZdqb3TadMwIENWZ8Hy-CtWvlJmJz16-JaEnpM0xHUZ_GfT6fxoA4U_fgfZitk8dLhAtzHNpwXfuE3oxdtX0sfpNz6QffiWRP0 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Project-Id: 293aba050c0e458a9d05bcbca5b49997 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeSwap-882310266 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/293aba050c0e458a9d05bcbca5b49997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/293aba050c0e458a9d05bcbca5b49997"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/293aba050c0e458a9d05bcbca5b49997"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeSwap-882310266 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Tenant-Id: 293aba050c0e458a9d05bcbca5b49997 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeSwap-882310266 Apr 14 00:09:31 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeSwap-882310266-project-member Apr 14 00:09:31 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:09:31 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:09:31 user devstack@n-api.service[72774]: X-User-Id: 6f81027ba772436092c0b317c3d5895d Apr 14 00:09:31 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeSwap-882310266-project-member Apr 14 00:09:31 user devstack@n-api.service[72774]: method: > Apr 14 00:09:31 user devstack@n-api.service[72774]: exception: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. Apr 14 00:09:31 user devstack@n-api.service[72774]: action_args: {'id': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2'} Apr 14 00:09:31 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. Apr 14 00:09:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:09:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Returning 404 to user: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:09:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-aac9f284-cf89-42c3-8126-a03bc9adc5ac tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" status: 404 len: 111 microversion: 2.1 time: 0.081239 Apr 14 00:09:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 142/301] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:31 2023] GET /compute/v2.1/servers/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:09:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ae6d4cd9-1f6a-4697-966f-7a5a4c429243 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Calling method '.version_select at 0x7f3db69a2680>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ae6d4cd9-1f6a-4697-966f-7a5a4c429243 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602525381" status: 202 len: 0 microversion: 2.1 time: 0.039299 Apr 14 00:09:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 128/302] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:09:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602525381 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:09:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "name": "network-vif-plugged", "status": "completed", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Creating event network-vif-plugged:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:09:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053073 Apr 14 00:09:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 143/303] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:33 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:33 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-67fdcabf-78e1-4fd2-b9fe-4c1be7c6e7fb tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1770 microversion: 2.87 time: 0.299444 Apr 14 00:09:33 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 129/304] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:09:33 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1770 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:09:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Creating event network-changed:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:09:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037363 Apr 14 00:09:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 144/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "name": "network-vif-plugged", "status": "completed", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Creating event network-vif-plugged:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:09:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Apr 14 00:09:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 130/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "name": "network-vif-plugged", "status": "completed", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Creating event network-vif-plugged:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:09:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Apr 14 00:09:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 145/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:37 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:37 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:37 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-51b469ca-130d-48c9-9376-b755d5a4938f tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1781 microversion: 2.20 time: 0.228892 Apr 14 00:09:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 131/308] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:09:36 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1781 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:09:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "name": "network-vif-plugged", "status": "completed", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Creating event network-vif-plugged:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:09:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038951 Apr 14 00:09:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 146/309] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:09:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:39 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-84c974d1-3c3e-4dfa-a9a9-317481236c1b tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05" status: 200 len: 1546 microversion: 2.1 time: 0.273653 Apr 14 00:09:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 132/310] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:39 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05 => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:41 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-fbe95cc1-7081-43af-b939-bf43a90672b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1705 microversion: 2.1 time: 0.262123 Apr 14 00:09:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 147/311] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:41 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1705 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=12 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:43 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3c7b5bfc-b523-499a-a4eb-75a1ba615c6f tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1698 microversion: 2.1 time: 0.373254 Apr 14 00:09:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 133/312] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:43 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1698 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=17 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:53 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9749aa60-b19c-4f7f-8427-85898addfe64 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1723 microversion: 2.1 time: 0.745938 Apr 14 00:09:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 148/313] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:53 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1723 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:56 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:56 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=5 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1929968798", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] validate_networks() for [('08106daa-a35e-4376-8c46-2b4baa51c6ea', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for user f43f3171ccad4167ac783bbdfe2df478 and project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:09:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.826193 Apr 14 00:09:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 134/314] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:09:56 2023] POST /compute/v2.1/servers => generated 381 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:09:57 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-56563899-1ab3-4912-82bb-e55762c228bf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:57 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-56563899-1ab3-4912-82bb-e55762c228bf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:57 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-56563899-1ab3-4912-82bb-e55762c228bf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:57 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-56563899-1ab3-4912-82bb-e55762c228bf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1216 microversion: 2.1 time: 0.068497 Apr 14 00:09:57 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 149/315] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:57 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-969325789", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:09:57 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] validate_networks() for [('08106daa-a35e-4376-8c46-2b4baa51c6ea', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for user f43f3171ccad4167ac783bbdfe2df478 and project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:09:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:09:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.524065 Apr 14 00:09:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 135/316] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:09:57 2023] POST /compute/v2.1/servers => generated 381 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:09:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d4a85cf1-abac-42a3-a6e1-6868104bc935 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:09:58 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-d4a85cf1-abac-42a3-a6e1-6868104bc935 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:09:58 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-d4a85cf1-abac-42a3-a6e1-6868104bc935 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:09:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d4a85cf1-abac-42a3-a6e1-6868104bc935 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 200 len: 1215 microversion: 2.1 time: 0.073329 Apr 14 00:09:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 150/317] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:09:58 2023] GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Creating event network-changed:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:10:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096207 Apr 14 00:10:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 136/318] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Creating event network-changed:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:10:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090346 Apr 14 00:10:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 151/319] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:04 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:10:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061306 Apr 14 00:10:04 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 137/320] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:04 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:10:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037351 Apr 14 00:10:04 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 152/321] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:10:06 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:10:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 Apr 14 00:10:06 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 138/322] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:10:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039705 Apr 14 00:10:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 153/323] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2aa1052c-9b9c-4419-82eb-cf3ccac8de4c tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Action: 'create', calling method: .version_select at 0x7f3db68388b0>, body: {"keypair": {"name": "tempest-keypair-84265846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:07 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-2aa1052c-9b9c-4419-82eb-cf3ccac8de4c tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting quotas for project be44ce9922f14c6fa75dc0f99b544851. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:10:07 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-2aa1052c-9b9c-4419-82eb-cf3ccac8de4c tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting quotas for user 85f2e1744d6c460a81c97f39a76ef5c7 and project be44ce9922f14c6fa75dc0f99b544851. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:10:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2aa1052c-9b9c-4419-82eb-cf3ccac8de4c tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.054124 Apr 14 00:10:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 139/324] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 00:10:07 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 00:10:09 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1988157619", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "4368ab10-ccfd-46d6-a0eb-296895d3ba19"}, {"port": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "tag": "port-1"}, {"port": "127b1d7d-d92a-4e24-9470-1758579376bf", "tag": "port-2"}, {"uuid": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "tag": "net-1"}, {"uuid": "0b416634-9a5d-4d0a-a891-fca1700a2d6b"}, {"uuid": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "70173bca-df37-41ee-adcb-1e0464d96d62", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "94fa4f60-6d5e-4c7b-b5a6-0923600a26e0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "215fee6a-a733-4408-a162-1e700d5bf7fc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--486749139"}], "key_name": "tempest-keypair-84265846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:09 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] validate_networks() for [('4368ab10-ccfd-46d6-a0eb-296895d3ba19', None, None, None, None, None), (None, None, 'e9ec2eab-0d7a-4be3-acab-a27bce761738', None, None, None), (None, None, '127b1d7d-d92a-4e24-9470-1758579376bf', None, None, None), ('0b416634-9a5d-4d0a-a891-fca1700a2d6b', None, None, None, None, None), ('0b416634-9a5d-4d0a-a891-fca1700a2d6b', None, None, None, None, None), ('700ca002-00ac-4a55-b2a5-f31c7ca9bcfa', '10.2.2.100', None, None, None, None), ('700ca002-00ac-4a55-b2a5-f31c7ca9bcfa', '10.2.2.200', None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting quotas for project be44ce9922f14c6fa75dc0f99b544851. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting quotas for user 85f2e1744d6c460a81c97f39a76ef5c7 and project be44ce9922f14c6fa75dc0f99b544851. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:10:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='70173bca-df37-41ee-adcb-1e0464d96d62',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='94fa4f60-6d5e-4c7b-b5a6-0923600a26e0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='215fee6a-a733-4408-a162-1e700d5bf7fc',volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:10:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 2.762916 Apr 14 00:10:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 154/325] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 00:10:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:10:12 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-40837748-8426-49f8-a998-a5f0cf08ba54 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:12 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-40837748-8426-49f8-a998-a5f0cf08ba54 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:12 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-40837748-8426-49f8-a998-a5f0cf08ba54 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:12 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-40837748-8426-49f8-a998-a5f0cf08ba54 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:12 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-40837748-8426-49f8-a998-a5f0cf08ba54 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-40837748-8426-49f8-a998-a5f0cf08ba54 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 200 len: 1278 microversion: 2.42 time: 0.079547 Apr 14 00:10:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 140/326] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:10:12 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:17 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:17 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e200c818-05b4-4ac5-bd24-be83122cdec4 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 200 len: 1545 microversion: 2.1 time: 0.730488 Apr 14 00:10:17 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 155/327] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:17 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 1545 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Creating event network-changed:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031437 Apr 14 00:10:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 141/328] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:20 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-dc342aa7-6be6-4a67-aeae-2e53b6cac281 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" status: 200 len: 1538 microversion: 2.1 time: 0.279535 Apr 14 00:10:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 156/329] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:20 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => generated 1538 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "e9ec2eab-0d7a-4be3-acab-a27bce761738"}, {"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "127b1d7d-d92a-4e24-9470-1758579376bf"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Creating event network-changed:e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Creating event network-changed:127b1d7d-d92a-4e24-9470-1758579376bf for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036134 Apr 14 00:10:20 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 142/330] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d"}, {"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "d3174ebb-df19-4943-98c4-89c97607f42b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:22 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:22 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Creating event network-changed:9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Creating event network-changed:d3174ebb-df19-4943-98c4-89c97607f42b for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032450 Apr 14 00:10:22 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 157/331] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:25 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=18 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9"}, {"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Creating event network-changed:dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Creating event network-changed:3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053457 Apr 14 00:10:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 143/332] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:25 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=29 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:10:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8" status: 204 len: 0 microversion: 2.1 time: 0.162471 Apr 14 00:10:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 158/333] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:10:30 2023] DELETE /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=7 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6564746aecb479c8e408df9600222cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d713f06b1714ade81068ed4f9edd035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-73af2a2b-e48f-481d-94f3-1d0517f230b0 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8" status: 200 len: 1492 microversion: 2.1 time: 0.249447 Apr 14 00:10:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 144/334] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:30 2023] GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8 => generated 1492 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db291c2f-a72c-46ce-8de8-3956de37ccf8", "name": "network-vif-unplugged", "status": "completed", "tag": "8916fec3-211a-470f-b70f-8a73690d3466"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Creating event network-vif-unplugged:8916fec3-211a-470f-b70f-8a73690d3466 for instance db291c2f-a72c-46ce-8de8-3956de37ccf8 on user Apr 14 00:10:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034524 Apr 14 00:10:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 159/335] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db291c2f-a72c-46ce-8de8-3956de37ccf8", "name": "network-vif-plugged", "status": "completed", "tag": "8916fec3-211a-470f-b70f-8a73690d3466"}, {"server_uuid": "db291c2f-a72c-46ce-8de8-3956de37ccf8", "name": "network-vif-deleted", "tag": "8916fec3-211a-470f-b70f-8a73690d3466"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Creating event network-vif-plugged:8916fec3-211a-470f-b70f-8a73690d3466 for instance db291c2f-a72c-46ce-8de8-3956de37ccf8 on user Apr 14 00:10:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Creating event network-vif-deleted:8916fec3-211a-470f-b70f-8a73690d3466 for instance db291c2f-a72c-46ce-8de8-3956de37ccf8 on user Apr 14 00:10:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043355 Apr 14 00:10:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 145/336] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "abb285f7-c82d-4a2c-be02-c183ea364f79"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:33 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'flavor' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:10:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd/action" status: 200 len: 29 microversion: 2.87 time: 0.467229 Apr 14 00:10:34 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 160/337] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:10:33 2023] POST /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd/action => generated 29 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:34 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:34 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-21f7eae2-5fcc-40f7-bc82-90669b0737c4 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1776 microversion: 2.87 time: 0.310395 Apr 14 00:10:34 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 146/338] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:10:34 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1776 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:10:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-unplugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Creating event network-vif-unplugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:10:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035153 Apr 14 00:10:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 161/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:10:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037005 Apr 14 00:10:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 147/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9277a0b0-14f8-4269-bbbf-8e2114a0153d tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments/af1b05d2-717a-489c-8bdf-160d00ebd122" status: 200 len: 194 microversion: 2.20 time: 0.157977 Apr 14 00:10:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 162/341] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 00:10:37 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments/af1b05d2-717a-489c-8bdf-160d00ebd122 => generated 194 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'services' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:10:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments/af1b05d2-717a-489c-8bdf-160d00ebd122" status: 202 len: 0 microversion: 2.20 time: 0.233216 Apr 14 00:10:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 148/342] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 00:10:37 2023] DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments/af1b05d2-717a-489c-8bdf-160d00ebd122 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-761cc5c8-2643-4645-afca-739c3792b88a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043344 Apr 14 00:10:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 163/343] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 00:10:37 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-47ae1c70-d65c-43e0-8ea0-b04fafaf33d1 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.106726 Apr 14 00:10:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 149/344] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:10:39 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-interface => generated 282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Creating event network-vif-plugged:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Apr 14 00:10:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 164/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "e9ec2eab-0d7a-4be3-acab-a27bce761738"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Creating event network-vif-plugged:e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030113 Apr 14 00:10:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 150/346] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/action" status: 202 len: 0 microversion: 2.1 time: 0.276246 Apr 14 00:10:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 165/347] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:10:41 2023] POST /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2523c691-7ae2-4afa-869b-a0555863f86a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.149881 Apr 14 00:10:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 151/348] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:10:42 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-interface => generated 283 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Creating event network-vif-plugged:9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113869 Apr 14 00:10:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 166/349] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}, {"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}, {"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Creating event network-changed:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:10:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Creating event network-vif-plugged:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:10:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:10:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.058797 Apr 14 00:10:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 152/350] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "e9ec2eab-0d7a-4be3-acab-a27bce761738"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "127b1d7d-d92a-4e24-9470-1758579376bf"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "127b1d7d-d92a-4e24-9470-1758579376bf"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "d3174ebb-df19-4943-98c4-89c97607f42b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Creating event network-vif-plugged:e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Creating event network-vif-plugged:127b1d7d-d92a-4e24-9470-1758579376bf for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Creating event network-vif-plugged:127b1d7d-d92a-4e24-9470-1758579376bf for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Creating event network-vif-plugged:d3174ebb-df19-4943-98c4-89c97607f42b for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043301 Apr 14 00:10:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 167/351] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb161de0-be74-4875-be21-dbca6bfcfc22"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'services' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-volume_attachments/5021c122-fea0-4125-8b1f-c1ab3c4de5e7" status: 202 len: 0 microversion: 2.1 time: 0.377867 Apr 14 00:10:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 153/352] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:10:43 2023] DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-volume_attachments/5021c122-fea0-4125-8b1f-c1ab3c4de5e7 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:10:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442253 Apr 14 00:10:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 168/353] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:10:44 2023] POST /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9"}, {"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-unplugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}, {"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Creating event network-vif-plugged:9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Creating event network-vif-plugged:dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Creating event network-vif-plugged:dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Creating event network-vif-unplugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:10:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.056581 Apr 14 00:10:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 154/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:44 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14"}, {"name": "network-changed", "server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}, {"name": "network-changed", "server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Creating event network-vif-plugged:3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Creating event network-changed:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:10:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Creating event network-changed:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:10:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Creating event network-vif-plugged:3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.043719 Apr 14 00:10:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 169/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:45 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "d3174ebb-df19-4943-98c4-89c97607f42b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Creating event network-vif-plugged:d3174ebb-df19-4943-98c4-89c97607f42b for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:10:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043516 Apr 14 00:10:45 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 155/356] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:10:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042732 Apr 14 00:10:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 170/357] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:47 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Going to try to stop instance {{(pid=72773) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 00:10:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action" status: 202 len: 0 microversion: 2.1 time: 0.110698 Apr 14 00:10:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 156/358] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:10:47 2023] POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1aa7af3c-5709-4c14-a358-25baae9b1714 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1662 microversion: 2.1 time: 0.233696 Apr 14 00:10:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 171/359] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:47 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1662 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-unplugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Creating event network-vif-unplugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:10:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039782 Apr 14 00:10:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 157/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:48 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-269a1f0f-b4ec-44b5-b8c9-39a0a2db1257 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 200 len: 1503 microversion: 2.1 time: 0.269173 Apr 14 00:10:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 172/361] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:48 2023] GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:10:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037313 Apr 14 00:10:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 158/362] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:10:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035992 Apr 14 00:10:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 173/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6e53ceec-d00e-4a05-8f64-f71bbb04f084"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] HTTP exception thrown: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Request method failure captured: Apr 14 00:10:53 user devstack@n-api.service[72773]: request: PUT /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments/bb161de0-be74-4875-be21-dbca6bfcfc22 HTTP/1.1 Apr 14 00:10:53 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:10:53 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:10:53 user devstack@n-api.service[72773]: Connection: close Apr 14 00:10:53 user devstack@n-api.service[72773]: Content-Length: 74 Apr 14 00:10:53 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:10:53 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:10:53 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:10:53 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJmORAx8rtYyMUMLU-omS_PdYspL_nR42e0SaAgVJOAHMoz2Cmzvnt4HxyC7f333H7eLYR0CXI64vR-N1LoaegXzTDaVYor2-RyA0fgLJJuboOpZBSuMmZtwL-sjF9b9h4WBmkgW_WszdWm2lkTU4CT6UPsHDl59TtLb7RAXSS6BnUI Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Project-Id: 0c091ccd8062479083a0a8b6ec25a48c Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesAdminNegativeTest-91805723 Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Role: member,reader,admin Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Roles: member,reader,admin Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c091ccd8062479083a0a8b6ec25a48c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c091ccd8062479083a0a8b6ec25a48c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c091ccd8062479083a0a8b6ec25a48c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesAdminNegativeTest-91805723 Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Tenant-Id: 0c091ccd8062479083a0a8b6ec25a48c Apr 14 00:10:53 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-91805723 Apr 14 00:10:53 user devstack@n-api.service[72773]: X-User: tempest-VolumesAdminNegativeTest-91805723-project-admin Apr 14 00:10:53 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:10:53 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:10:53 user devstack@n-api.service[72773]: X-User-Id: 8fe936f560b743f496208d0ea2ae67cb Apr 14 00:10:53 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesAdminNegativeTest-91805723-project-admin Apr 14 00:10:53 user devstack@n-api.service[72773]: Apr 14 00:10:53 user devstack@n-api.service[72773]: {"volumeAttachment": {"volumeId": "6e53ceec-d00e-4a05-8f64-f71bbb04f084"}} Apr 14 00:10:53 user devstack@n-api.service[72773]: method: > Apr 14 00:10:53 user devstack@n-api.service[72773]: exception: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. Apr 14 00:10:53 user devstack@n-api.service[72773]: action_args: {'server_id': '8feba40a-03c7-4c60-b862-ee14fb8c9b05', 'id': 'bb161de0-be74-4875-be21-dbca6bfcfc22', 'body': {'volumeAttachment': {'volumeId': '6e53ceec-d00e-4a05-8f64-f71bbb04f084'}}} Apr 14 00:10:53 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. (HTTP 404) (Request-ID: req-6a1bcc59-4e30-4619-8e91-2d1d2211fc3e) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. Apr 14 00:10:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Returning 400 to user: Volume 6e53ceec-d00e-4a05-8f64-f71bbb04f084 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:10:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-99d400f5-bd6b-43ca-8988-6d20de361a32 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments/bb161de0-be74-4875-be21-dbca6bfcfc22" status: 400 len: 107 microversion: 2.1 time: 0.241773 Apr 14 00:10:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 159/364] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 00:10:53 2023] PUT /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments/bb161de0-be74-4875-be21-dbca6bfcfc22 => generated 107 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'services' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:10:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments/bb161de0-be74-4875-be21-dbca6bfcfc22" status: 202 len: 0 microversion: 2.1 time: 0.162823 Apr 14 00:10:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 174/365] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:10:53 2023] DELETE /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments/bb161de0-be74-4875-be21-dbca6bfcfc22 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-70f1d7ca-438c-4665-882c-3b18b07e9a49 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074843 Apr 14 00:10:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 160/366] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:10:53 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:54 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ffad3a30-dd7c-4bf3-8522-043b716c6f38 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1723 microversion: 2.1 time: 0.923198 Apr 14 00:10:54 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 175/367] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:53 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1723 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:10:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:10:55 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:10:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4b8133d4-0343-4651-97b1-3dad9ae3efd9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1723 microversion: 2.1 time: 0.178396 Apr 14 00:10:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 161/368] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:10:54 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:02 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e1b0fb6f-80b8-4ae4-8701-065131eb3022 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 200 len: 2826 microversion: 2.42 time: 0.217881 Apr 14 00:11:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 176/369] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:11:02 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 2826 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=37 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:16 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'services' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:11:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments/028eff5c-aa61-4243-985e-5210aedff04a" status: 202 len: 0 microversion: 2.1 time: 0.187678 Apr 14 00:11:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 162/370] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:11:16 2023] DELETE /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments/028eff5c-aa61-4243-985e-5210aedff04a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0848c6ba-602d-4551-8e09-3a553e6d73b9 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Apr 14 00:11:16 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 177/371] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:11:16 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c37c9edb-c751-4e99-b701-be0a7dee63e9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.090950 Apr 14 00:11:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 163/372] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:11:17 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Creating event network-changed:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:11:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Apr 14 00:11:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 178/373] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-feb24b7c-798f-4bdb-9580-a9c2e5dd8340 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/ips" status: 200 len: 108 microversion: 2.1 time: 0.038061 Apr 14 00:11:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 164/374] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:11:19 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ba2057-0822-4741-b91d-718067f21593"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Invalid volume: volume 43ba2057-0822-4741-b91d-718067f21593 is already attached to instances: e3fba4ee-4aae-4ee3-8114-b53510f5442c Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:11:19 user devstack@n-api.service[72774]: request: POST /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/os-volume_attachments HTTP/1.1 Apr 14 00:11:19 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:11:19 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:11:19 user devstack@n-api.service[72774]: Connection: close Apr 14 00:11:19 user devstack@n-api.service[72774]: Content-Length: 74 Apr 14 00:11:19 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:11:19 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:11:19 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:11:19 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:11:19 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:11:19 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:11:19 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:11:19 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:11:19 user devstack@n-api.service[72774]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:11:19 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:11:19 user devstack@n-api.service[72774]: Apr 14 00:11:19 user devstack@n-api.service[72774]: {"volumeAttachment": {"volumeId": "43ba2057-0822-4741-b91d-718067f21593"}} Apr 14 00:11:19 user devstack@n-api.service[72774]: method: > Apr 14 00:11:19 user devstack@n-api.service[72774]: exception: Invalid volume: volume 43ba2057-0822-4741-b91d-718067f21593 is already attached to instances: e3fba4ee-4aae-4ee3-8114-b53510f5442c Apr 14 00:11:19 user devstack@n-api.service[72774]: action_args: {'server_id': 'b21b91b1-a98b-48c7-a2e8-4114c3e31345', 'body': {'volumeAttachment': {'volumeId': '43ba2057-0822-4741-b91d-718067f21593'}}} Apr 14 00:11:19 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 43ba2057-0822-4741-b91d-718067f21593 is already attached to instances: e3fba4ee-4aae-4ee3-8114-b53510f5442c Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 43ba2057-0822-4741-b91d-718067f21593 is already attached to instances: e3fba4ee-4aae-4ee3-8114-b53510f5442c Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 43ba2057-0822-4741-b91d-718067f21593 is already attached to instances: e3fba4ee-4aae-4ee3-8114-b53510f5442c Apr 14 00:11:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 400 to user: Invalid volume: volume 43ba2057-0822-4741-b91d-718067f21593 is already attached to instances: e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:11:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1557ae2a-d9f6-4f07-ad12-1709581af4f2 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116602 Apr 14 00:11:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 179/375] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:11:19 2023] POST /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:11:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 204 len: 0 microversion: 2.1 time: 0.219737 Apr 14 00:11:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 165/376] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:11:19 2023] DELETE /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-251ca80e-1afb-46a6-bacb-6ecdbd19dbf9 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 200 len: 1551 microversion: 2.1 time: 0.221479 Apr 14 00:11:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 180/377] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:11:19 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 1551 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "name": "network-vif-unplugged", "status": "completed", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Creating event network-vif-unplugged:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:11:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033646 Apr 14 00:11:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 166/378] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:20 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ec2d9536-0e73-4f1e-afce-545ecc2b5899 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" status: 200 len: 1538 microversion: 2.1 time: 0.341670 Apr 14 00:11:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 181/379] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:11:20 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => generated 1538 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] HTTP exception thrown: Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 could not be found. Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Request method failure captured: Apr 14 00:11:20 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8 HTTP/1.1 Apr 14 00:11:20 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:11:20 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:11:20 user devstack@n-api.service[72773]: Connection: close Apr 14 00:11:20 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:11:20 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:11:20 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:11:20 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:11:20 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJl3aLXM5GzqfNaRREgsR4qLy4jQZIxumD-GRSW5HJta2Zrg6aeWnbbhNrjCgfsZq7_9m2wBHb6NFq0JiUgCaHWcCyAPWK37pLPbD1vIs2ok9a3CJ3ZlSnRuwtKmpe_qKREDUNZokfRKt2i61U6V3fmy0NY2g925d6wvOVJj9y9VRBE Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Project-Id: 8d713f06b1714ade81068ed4f9edd035 Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesActionsTest-599923376 Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d713f06b1714ade81068ed4f9edd035"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d713f06b1714ade81068ed4f9edd035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d713f06b1714ade81068ed4f9edd035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesActionsTest-599923376 Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Tenant-Id: 8d713f06b1714ade81068ed4f9edd035 Apr 14 00:11:20 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesActionsTest-599923376 Apr 14 00:11:20 user devstack@n-api.service[72773]: X-User: tempest-VolumesActionsTest-599923376-project-member Apr 14 00:11:20 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:11:20 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:11:20 user devstack@n-api.service[72773]: X-User-Id: f6564746aecb479c8e408df9600222cb Apr 14 00:11:20 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesActionsTest-599923376-project-member Apr 14 00:11:20 user devstack@n-api.service[72773]: method: > Apr 14 00:11:20 user devstack@n-api.service[72773]: exception: Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 could not be found. Apr 14 00:11:20 user devstack@n-api.service[72773]: action_args: {'id': 'db291c2f-a72c-46ce-8de8-3956de37ccf8'} Apr 14 00:11:20 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 could not be found. Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 could not be found. Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 could not be found. Apr 14 00:11:20 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:11:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Returning 404 to user: Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:11:20 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ca9fde5a-20ba-4a7d-bdc5-281c6a397e47 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8" status: 404 len: 111 microversion: 2.1 time: 0.034927 Apr 14 00:11:20 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 167/380] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:11:20 2023] GET /compute/v2.1/servers/db291c2f-a72c-46ce-8de8-3956de37ccf8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:11:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "name": "network-vif-deleted", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] Creating event network-vif-deleted:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:11:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039095 Apr 14 00:11:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 182/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21b91b1-a98b-48c7-a2e8-4114c3e31345", "name": "network-vif-plugged", "status": "completed", "tag": "01f28b85-9614-4a93-bc9b-7b894b96313a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Creating event network-vif-plugged:01f28b85-9614-4a93-bc9b-7b894b96313a for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 on user Apr 14 00:11:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047267 Apr 14 00:11:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 168/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Creating event network-changed:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:11:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051953 Apr 14 00:11:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 183/383] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a4ad5f1-58f1-4934-b18f-9890ae47ecde"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327443 Apr 14 00:11:24 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 169/384] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:11:24 2023] POST /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:24 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6d525971-9846-465a-b8de-6379805ef106 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1756 microversion: 2.87 time: 0.231581 Apr 14 00:11:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 184/385] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:11:24 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:11:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:27 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d89b3536-5dd5-45a6-bfb0-57dc840e7e3e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052204 Apr 14 00:11:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 170/386] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 00:11:27 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:11:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 204 len: 0 microversion: 2.20 time: 0.120148 Apr 14 00:11:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 185/387] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:11:28 2023] DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6bda9711-486b-4783-9b22-d5e8d03e33bd tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 200 len: 1709 microversion: 2.20 time: 0.190707 Apr 14 00:11:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 171/388] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:11:28 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-unplugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Creating event network-vif-unplugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:11:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030630 Apr 14 00:11:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 186/389] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-plugged", "status": "completed", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}, {"server_uuid": "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a", "name": "network-vif-deleted", "tag": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Creating event network-vif-plugged:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:11:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Creating event network-vif-deleted:1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a on user Apr 14 00:11:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039625 Apr 14 00:11:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 172/390] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:32 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'services' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:11:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments/9a4ad5f1-58f1-4934-b18f-9890ae47ecde" status: 202 len: 0 microversion: 2.1 time: 0.282279 Apr 14 00:11:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 187/391] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:11:32 2023] DELETE /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments/9a4ad5f1-58f1-4934-b18f-9890ae47ecde => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-626e2b35-66c3-4f37-bd48-3f79d5c42c43 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087414 Apr 14 00:11:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 173/392] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:11:32 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:38 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3ef1b924-cb2e-44ba-9796-f51bb2768309 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1639 microversion: 2.1 time: 0.212304 Apr 14 00:11:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 188/393] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:11:38 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1639 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9cd5e6e0-45bc-4ee9-9095-1b61dbd49e3d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055320 Apr 14 00:11:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 174/394] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:11:43 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-558458744", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] validate_networks() for [('49f71fbc-7d65-4cc6-9efe-3918d5dbd51a', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting quotas for project dffbe999e60a4add9f23c83f9b0a4252. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting quotas for user 74d7e3d598e74c288e6a44996303b85e and project dffbe999e60a4add9f23c83f9b0a4252. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:11:44 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:11:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.618856 Apr 14 00:11:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 189/395] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:11:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:11:44 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-fb07a82f-b391-4cde-8db3-36583273c230 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:44 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fb07a82f-b391-4cde-8db3-36583273c230 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:44 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-fb07a82f-b391-4cde-8db3-36583273c230 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-fb07a82f-b391-4cde-8db3-36583273c230 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008" status: 200 len: 1211 microversion: 2.1 time: 0.069628 Apr 14 00:11:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 175/396] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:11:44 2023] GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008 => generated 1211 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493c65ce-aceb-4273-926e-d3633e676008", "tag": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:47 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:47 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Creating event network-changed:6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance 493c65ce-aceb-4273-926e-d3633e676008 on user Apr 14 00:11:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Apr 14 00:11:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 190/397] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:48 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:11:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/action" status: 200 len: 32 microversion: 2.1 time: 0.172000 Apr 14 00:11:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 176/398] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:11:48 2023] POST /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:49 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:11:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b023f114-390b-4537-bd96-a938c69d84f1 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 200 len: 1509 microversion: 2.1 time: 0.216044 Apr 14 00:11:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 191/399] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:11:49 2023] GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:11:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493c65ce-aceb-4273-926e-d3633e676008", "name": "network-vif-plugged", "status": "completed", "tag": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Creating event network-vif-plugged:6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance 493c65ce-aceb-4273-926e-d3633e676008 on user Apr 14 00:11:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039638 Apr 14 00:11:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 177/400] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-unplugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Creating event network-vif-unplugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040169 Apr 14 00:11:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 192/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493c65ce-aceb-4273-926e-d3633e676008", "name": "network-vif-plugged", "status": "completed", "tag": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Creating event network-vif-plugged:6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance 493c65ce-aceb-4273-926e-d3633e676008 on user Apr 14 00:11:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039156 Apr 14 00:11:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 178/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}, {"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}, {"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}, {"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-unplugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}, {"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Creating event network-vif-unplugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.049205 Apr 14 00:11:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 193/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}, {"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:11:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:11:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039945 Apr 14 00:11:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 179/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:11:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:55 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'services' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:11:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments/49172d5a-2944-486a-a080-04548e55ac0d" status: 202 len: 0 microversion: 2.1 time: 0.206517 Apr 14 00:11:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 194/405] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:11:55 2023] DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments/49172d5a-2944-486a-a080-04548e55ac0d => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:11:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:11:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c6cdd92f-48cf-46f4-8764-0e1f4aa70216 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065917 Apr 14 00:11:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 180/406] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:11:55 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9a3f1d3d-6d58-4f1d-bafb-94161005f2f2 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.196745 Apr 14 00:12:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 195/407] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 00:12:02 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/os-interface => generated 1831 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:12:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Creating event network-changed:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033560 Apr 14 00:12:03 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 181/408] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:04 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:04 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:04 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-bbb8ba78-7dd9-4c0a-b7a8-8c8b28a46cf7 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 200 len: 2826 microversion: 2.42 time: 0.206825 Apr 14 00:12:04 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 196/409] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:03 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 2826 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-98176ed0-ae46-4722-966f-3aa75043ac26 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.125235 Apr 14 00:12:04 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 182/410] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 00:12:04 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/os-interface => generated 1831 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:12:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 204 len: 0 microversion: 2.42 time: 0.119763 Apr 14 00:12:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 197/411] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:12:05 2023] DELETE /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c0c44ecd-fec2-4095-aef9-d463325d2615 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 200 len: 2950 microversion: 2.42 time: 0.253925 Apr 14 00:12:05 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 183/412] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:05 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 2950 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Creating event network-vif-unplugged:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033913 Apr 14 00:12:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 198/413] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "e9ec2eab-0d7a-4be3-acab-a27bce761738"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:05 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Creating event network-vif-unplugged:e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:05 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050907 Apr 14 00:12:05 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 184/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Creating event network-vif-unplugged:9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031527 Apr 14 00:12:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 199/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f7286c7d-41ff-4d7a-843e-1ede566b75ef tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052743 Apr 14 00:12:06 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 185/416] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:12:06 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:12:07 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Creating event network-vif-plugged:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Creating event network-vif-unplugged:3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Creating event network-vif-plugged:3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035064 Apr 14 00:12:07 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 200/417] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "e9ec2eab-0d7a-4be3-acab-a27bce761738"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "127b1d7d-d92a-4e24-9470-1758579376bf"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "127b1d7d-d92a-4e24-9470-1758579376bf"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "d3174ebb-df19-4943-98c4-89c97607f42b"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "d3174ebb-df19-4943-98c4-89c97607f42b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Creating event network-vif-plugged:e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Creating event network-vif-unplugged:127b1d7d-d92a-4e24-9470-1758579376bf for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Creating event network-vif-plugged:127b1d7d-d92a-4e24-9470-1758579376bf for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Creating event network-vif-unplugged:d3174ebb-df19-4943-98c4-89c97607f42b for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Creating event network-vif-plugged:d3174ebb-df19-4943-98c4-89c97607f42b for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.034812 Apr 14 00:12:08 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 186/418] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:08 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-plugged", "status": "completed", "tag": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Creating event network-vif-plugged:9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Creating event network-vif-unplugged:dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Creating event network-vif-plugged:dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.036702 Apr 14 00:12:08 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 201/419] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:12:09 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 HTTP/1.1 Apr 14 00:12:09 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:12:09 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:12:09 user devstack@n-api.service[72773]: Connection: close Apr 14 00:12:09 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:12:09 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:12:09 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:12:09 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:12:09 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:12:09 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:12:09 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:12:09 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:12:09 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:12:09 user devstack@n-api.service[72773]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:12:09 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:12:09 user devstack@n-api.service[72773]: method: > Apr 14 00:12:09 user devstack@n-api.service[72773]: exception: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:12:09 user devstack@n-api.service[72773]: action_args: {'id': 'b21b91b1-a98b-48c7-a2e8-4114c3e31345'} Apr 14 00:12:09 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:12:09 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:12:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-115e2e70-c813-4558-913e-f9a88a4b678b tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 404 len: 111 microversion: 2.1 time: 0.031068 Apr 14 00:12:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 187/420] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:09 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:12:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ab5ec53f-e475-4efe-8f99-5e03b7b82a31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '.version_select at 0x7f3db69a1750>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-64e60411-4981-4596-91a7-783ed2ff6b67 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '.version_select at 0x7f3db6657520>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ab5ec53f-e475-4efe-8f99-5e03b7b82a31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420639753" status: 202 len: 0 microversion: 2.1 time: 0.028759 Apr 14 00:12:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 188/421] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:12:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420639753 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:12:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-64e60411-4981-4596-91a7-783ed2ff6b67 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1" status: 204 len: 0 microversion: 2.1 time: 0.259054 Apr 14 00:12:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 202/422] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:09 2023] DELETE /compute/v2.1/images/b55f3d04-4ac0-4525-8efe-35fed088afe1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:12:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 204 len: 0 microversion: 2.1 time: 0.152467 Apr 14 00:12:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 189/423] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:12:10 2023] DELETE /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a03076db-e5ea-438a-8009-907f6008d49e tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 200 len: 1679 microversion: 2.1 time: 0.251666 Apr 14 00:12:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 203/424] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:10 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-deleted", "tag": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] Creating event network-vif-deleted:3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036670 Apr 14 00:12:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 190/425] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-unplugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Creating event network-vif-unplugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:12:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038175 Apr 14 00:12:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 204/426] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:11 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'services' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:12:11 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments/43ba2057-0822-4741-b91d-718067f21593" status: 202 len: 0 microversion: 2.1 time: 0.184653 Apr 14 00:12:11 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 191/427] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:12:11 2023] DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments/43ba2057-0822-4741-b91d-718067f21593 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:12:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a0bfd602-c550-4385-898c-3a311a11bc5a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 Apr 14 00:12:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 205/428] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:12:11 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-deleted", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] Creating event network-vif-deleted:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:12:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044628 Apr 14 00:12:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 192/429] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-deleted", "tag": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-deleted", "tag": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-deleted", "tag": "d3174ebb-df19-4943-98c4-89c97607f42b"}, {"server_uuid": "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c", "name": "network-vif-deleted", "tag": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Creating event network-vif-deleted:1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Creating event network-vif-deleted:dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Creating event network-vif-deleted:d3174ebb-df19-4943-98c4-89c97607f42b for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] Creating event network-vif-deleted:9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c on user Apr 14 00:12:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.069879 Apr 14 00:12:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 206/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:12 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97", "name": "network-vif-plugged", "status": "completed", "tag": "4085de4c-cb9e-452b-9504-b7c7f8621213"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Creating event network-vif-plugged:4085de4c-cb9e-452b-9504-b7c7f8621213 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 on user Apr 14 00:12:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036066 Apr 14 00:12:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 193/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HTTP exception thrown: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Request method failure captured: Apr 14 00:12:18 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a HTTP/1.1 Apr 14 00:12:18 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:12:18 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:12:18 user devstack@n-api.service[72774]: Connection: close Apr 14 00:12:18 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:12:18 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:12:18 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:12:18 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:12:18 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJihF036sdyF-5p0q2jmgiP2QHAhR_3g2LsFN9AhQnXY0Sj7HhV2ioG40LfatRJk1Lg45saDsHPRtkGgU1tQonJiCZ6ikfwfsXpY0I1mNMTBciZZ1nj8zMtoiY19f9kPki4Ku8zrfXG2hYhYT3l23uuEkYR2eE788jMsNfEsTGbKQzs Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Project-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Tenant-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:12:18 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:12:18 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:12:18 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:12:18 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:12:18 user devstack@n-api.service[72774]: X-User-Id: 2f8b18d40ecd4b4e976cf2018af8220c Apr 14 00:12:18 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:12:18 user devstack@n-api.service[72774]: method: > Apr 14 00:12:18 user devstack@n-api.service[72774]: exception: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:12:18 user devstack@n-api.service[72774]: action_args: {'id': '1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a'} Apr 14 00:12:18 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:12:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Returning 404 to user: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:12:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-246e4c99-fcf5-44e9-bbca-43a040df7807 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 404 len: 111 microversion: 2.20 time: 0.049172 Apr 14 00:12:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 207/432] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:18 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:12:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-25916e75-c13f-4d18-bc10-ca59f1939158 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '.version_select at 0x7f3db68f09d0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-25916e75-c13f-4d18-bc10-ca59f1939158 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138977160" status: 204 len: 0 microversion: 2.20 time: 0.026093 Apr 14 00:12:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 194/433] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 00:12:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138977160 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:12:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-daaf4f59-7a7e-4e08-9e4d-ed5ad950de39 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'create', calling method: .version_select at 0x7f3db6656560>, body: {"keypair": {"name": "tempest-keypair-749403403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4UEOyJwYDEnyxQAY/gseNadkyiHeTpfezaewpCqENgdXuLtykmPySbfnvUAXob1mjZ2nh6y7mHb/UX7vHeRXLyyBaoGtHKG1dH84NmufncEafrHDE/Zf0amaymIZieug=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:19 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-daaf4f59-7a7e-4e08-9e4d-ed5ad950de39 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:12:19 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-daaf4f59-7a7e-4e08-9e4d-ed5ad950de39 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for user 2f8b18d40ecd4b4e976cf2018af8220c and project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:12:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-daaf4f59-7a7e-4e08-9e4d-ed5ad950de39 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053484 Apr 14 00:12:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 208/434] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 00:12:19 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1217758263", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "66316d10-fed3-4fb9-877e-a01542ca5855"}], "security_groups": [{"name": "tempest-securitygroup--795632013"}], "key_name": "tempest-keypair-749403403", "user_data": "}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] validate_networks() for [('66316d10-fed3-4fb9-877e-a01542ca5855', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting quotas for user 2f8b18d40ecd4b4e976cf2018af8220c and project 4f20caf676a64b9b97027f3fc9bc724c. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:12:21 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:12:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.618911 Apr 14 00:12:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 195/435] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:12:21 2023] POST /compute/v2.1/servers => generated 399 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 14 00:12:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bfff22cb-0872-4a98-96d1-e03ae3fdafa4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:21 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-bfff22cb-0872-4a98-96d1-e03ae3fdafa4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-bfff22cb-0872-4a98-96d1-e03ae3fdafa4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-bfff22cb-0872-4a98-96d1-e03ae3fdafa4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-bfff22cb-0872-4a98-96d1-e03ae3fdafa4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-bfff22cb-0872-4a98-96d1-e03ae3fdafa4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1275 microversion: 2.20 time: 0.087671 Apr 14 00:12:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 209/436] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:21 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-93e30801-c543-481d-9a5c-d16b927d4351 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054503 Apr 14 00:12:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 196/437] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:12:22 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Creating event network-changed:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:12:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032113 Apr 14 00:12:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 197/438] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:23 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:12:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" status: 204 len: 0 microversion: 2.1 time: 0.120443 Apr 14 00:12:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 210/439] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:12:23 2023] DELETE /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:24 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-30ebb4e1-e291-42d0-9fc6-c486d7b73f3a tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" status: 200 len: 1663 microversion: 2.1 time: 0.267337 Apr 14 00:12:24 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 198/440] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:23 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => generated 1663 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "name": "network-vif-unplugged", "status": "completed", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Creating event network-vif-unplugged:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:12:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029082 Apr 14 00:12:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 211/441] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd/action" status: 202 len: 0 microversion: 2.87 time: 0.080304 Apr 14 00:12:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 199/442] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:12:25 2023] POST /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:25 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-53d80bca-31ff-41b9-9c9b-ebf7c43474ec tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1764 microversion: 2.87 time: 0.292949 Apr 14 00:12:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 212/443] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:25 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1764 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "name": "network-vif-deleted", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] Creating event network-vif-deleted:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:12:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032771 Apr 14 00:12:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 200/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:12:26 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b", "name": "network-vif-plugged", "status": "completed", "tag": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c"}, {"name": "network-changed", "server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}, {"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-unplugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}, {"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Creating event network-vif-plugged:e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b on user Apr 14 00:12:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Creating event network-changed:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:12:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Creating event network-vif-unplugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:12:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:12:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.041112 Apr 14 00:12:26 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 213/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-plugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}, {"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-plugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Creating event network-vif-plugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:12:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Creating event network-vif-plugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:12:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033097 Apr 14 00:12:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 201/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:12:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:12:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Apr 14 00:12:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 214/447] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:12:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037862 Apr 14 00:12:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 202/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:35 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-55f9ade1-dc8f-441f-81bd-a79de90d13ef tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008" status: 200 len: 1496 microversion: 2.1 time: 0.208221 Apr 14 00:12:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 215/449] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:34 2023] GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008 => generated 1496 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:38 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Going to try to start instance {{(pid=72773) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 00:12:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action" status: 202 len: 0 microversion: 2.1 time: 0.072825 Apr 14 00:12:38 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 203/450] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:12:38 2023] POST /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:38 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-42991e62-e372-4867-bf96-c49e8bf32eb5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1648 microversion: 2.1 time: 0.322031 Apr 14 00:12:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 216/451] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:38 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1648 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:39 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-924d8665-5a05-4cbc-87ea-01512531e42e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 200 len: 1489 microversion: 2.1 time: 0.148990 Apr 14 00:12:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 204/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:39 2023] GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 1489 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:12:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040961 Apr 14 00:12:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 217/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:12:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:12:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Apr 14 00:12:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 205/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:12:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-346e08ac-cd3e-45ac-96a7-c433270abc44 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043954 Apr 14 00:12:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 218/455] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:12:45 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2955ed7f-dee1-48f0-88ae-1979c3418930 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1677 microversion: 2.1 time: 0.282193 Apr 14 00:12:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 206/456] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:45 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:46 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-93b79f93-b171-457a-94bb-8de2c8c80581 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1677 microversion: 2.1 time: 0.191944 Apr 14 00:12:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 219/457] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:46 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:46 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:12:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8ced5775-3d2e-4abd-b79f-79bc3f6b0517 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1677 microversion: 2.1 time: 0.486912 Apr 14 00:12:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 207/458] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:12:46 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1677 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] HTTP exception thrown: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Request method failure captured: Apr 14 00:12:55 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c HTTP/1.1 Apr 14 00:12:55 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:12:55 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:12:55 user devstack@n-api.service[72774]: Connection: close Apr 14 00:12:55 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:12:55 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:12:55 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:12:55 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:12:55 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJnIkeI0MCMfR49Cl4f-eLqa0SWCDU-wrqaOye8HAhQI1kmOlHqihA_Mi4E5CfqG8bdKxmourZf7v4XBbOisNIG0CPuZPrCDxtBSupffyzSW31vRfC3KxMYLV-6W4AkeTDxofKlYY03PeLdYbJEF2u3gFdFaALtxXzzpxOCoFPy6tkM Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Project-Id: be44ce9922f14c6fa75dc0f99b544851 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Tenant-Id: be44ce9922f14c6fa75dc0f99b544851 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-User: tempest-TaggedBootDevicesTest_v242-1295697559-project-member Apr 14 00:12:55 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:12:55 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:12:55 user devstack@n-api.service[72774]: X-User-Id: 85f2e1744d6c460a81c97f39a76ef5c7 Apr 14 00:12:55 user devstack@n-api.service[72774]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1295697559-project-member Apr 14 00:12:55 user devstack@n-api.service[72774]: method: > Apr 14 00:12:55 user devstack@n-api.service[72774]: exception: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:55 user devstack@n-api.service[72774]: action_args: {'id': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'} Apr 14 00:12:55 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:55 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Returning 404 to user: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:12:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5362b411-bcee-4486-9d67-74cb1df11443 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 404 len: 111 microversion: 2.42 time: 0.038913 Apr 14 00:12:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 220/459] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:55 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:12:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ee5806a3-c418-4d8e-a11c-c6e313251007 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '.version_select at 0x7f3db69a3eb0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ee5806a3-c418-4d8e-a11c-c6e313251007 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84265846" status: 204 len: 0 microversion: 2.42 time: 0.026359 Apr 14 00:12:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 208/460] 10.0.0.210 () {64 vars in 1333 bytes} [Fri Apr 14 00:12:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84265846 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] HTTP exception thrown: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Request method failure captured: Apr 14 00:12:58 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c HTTP/1.1 Apr 14 00:12:58 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:12:58 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:12:58 user devstack@n-api.service[72774]: Connection: close Apr 14 00:12:58 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:12:58 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:12:58 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:12:58 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:12:58 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJnIkeI0MCMfR49Cl4f-eLqa0SWCDU-wrqaOye8HAhQI1kmOlHqihA_Mi4E5CfqG8bdKxmourZf7v4XBbOisNIG0CPuZPrCDxtBSupffyzSW31vRfC3KxMYLV-6W4AkeTDxofKlYY03PeLdYbJEF2u3gFdFaALtxXzzpxOCoFPy6tkM Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Project-Id: be44ce9922f14c6fa75dc0f99b544851 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Tenant-Id: be44ce9922f14c6fa75dc0f99b544851 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-User: tempest-TaggedBootDevicesTest_v242-1295697559-project-member Apr 14 00:12:58 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:12:58 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:12:58 user devstack@n-api.service[72774]: X-User-Id: 85f2e1744d6c460a81c97f39a76ef5c7 Apr 14 00:12:58 user devstack@n-api.service[72774]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1295697559-project-member Apr 14 00:12:58 user devstack@n-api.service[72774]: method: > Apr 14 00:12:58 user devstack@n-api.service[72774]: exception: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:58 user devstack@n-api.service[72774]: action_args: {'id': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'} Apr 14 00:12:58 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:58 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:12:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Returning 404 to user: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:12:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-78c6efff-af8a-4c56-8aac-7a4769884ef0 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 404 len: 111 microversion: 2.42 time: 0.035942 Apr 14 00:12:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 221/461] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:12:58 2023] DELETE /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:12:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:12:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] HTTP exception thrown: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:59 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Request method failure captured: Apr 14 00:12:59 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c HTTP/1.1 Apr 14 00:12:59 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:12:59 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:12:59 user devstack@n-api.service[72773]: Connection: close Apr 14 00:12:59 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:12:59 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:12:59 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:12:59 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:12:59 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJnIkeI0MCMfR49Cl4f-eLqa0SWCDU-wrqaOye8HAhQI1kmOlHqihA_Mi4E5CfqG8bdKxmourZf7v4XBbOisNIG0CPuZPrCDxtBSupffyzSW31vRfC3KxMYLV-6W4AkeTDxofKlYY03PeLdYbJEF2u3gFdFaALtxXzzpxOCoFPy6tkM Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Project-Id: be44ce9922f14c6fa75dc0f99b544851 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be44ce9922f14c6fa75dc0f99b544851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Tenant-Id: be44ce9922f14c6fa75dc0f99b544851 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1295697559 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-User: tempest-TaggedBootDevicesTest_v242-1295697559-project-member Apr 14 00:12:59 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:12:59 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:12:59 user devstack@n-api.service[72773]: X-User-Id: 85f2e1744d6c460a81c97f39a76ef5c7 Apr 14 00:12:59 user devstack@n-api.service[72773]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1295697559-project-member Apr 14 00:12:59 user devstack@n-api.service[72773]: method: > Apr 14 00:12:59 user devstack@n-api.service[72773]: exception: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:59 user devstack@n-api.service[72773]: action_args: {'id': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'} Apr 14 00:12:59 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. Apr 14 00:12:59 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:12:59 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Returning 404 to user: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:12:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4269cd23-a02a-4495-a8d5-e66861850d31 tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" status: 404 len: 111 microversion: 2.42 time: 0.034725 Apr 14 00:12:59 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 209/462] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:12:58 2023] GET /compute/v2.1/servers/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] HTTP exception thrown: Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 could not be found. Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Request method failure captured: Apr 14 00:13:00 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 HTTP/1.1 Apr 14 00:13:00 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:13:00 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:13:00 user devstack@n-api.service[72774]: Connection: close Apr 14 00:13:00 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:13:00 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:13:00 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:13:00 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:13:00 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJickkLC6vpaI_lpr86iK_iFzgosC88VACBLysjnofURoFdSb879CyxAn7jxfAS0uUREprJWwNWQE49TJJp0scKn9-NbDAeM5os7UVWnJdSATlN3wegccvNquMqQ9L_hnuL9UwfrKBDBas4LJH7thhbnSS_lONprJsRAaDgT4X2ULt8 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Project-Id: c931198e56de4cf08db59bcc40f2a260 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerStableDeviceRescueTest-481368698 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c931198e56de4cf08db59bcc40f2a260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c931198e56de4cf08db59bcc40f2a260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c931198e56de4cf08db59bcc40f2a260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerStableDeviceRescueTest-481368698 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Tenant-Id: c931198e56de4cf08db59bcc40f2a260 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-481368698 Apr 14 00:13:00 user devstack@n-api.service[72774]: X-User: tempest-ServerStableDeviceRescueTest-481368698-project-member Apr 14 00:13:00 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:13:00 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:13:00 user devstack@n-api.service[72774]: X-User-Id: 97374cd3cdc448cd8710561d44756ead Apr 14 00:13:00 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerStableDeviceRescueTest-481368698-project-member Apr 14 00:13:00 user devstack@n-api.service[72774]: method: > Apr 14 00:13:00 user devstack@n-api.service[72774]: exception: Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 could not be found. Apr 14 00:13:00 user devstack@n-api.service[72774]: action_args: {'id': '3a6b9f89-e462-47d8-84a1-0ac4ade3ab97'} Apr 14 00:13:00 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 could not be found. Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 could not be found. Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 could not be found. Apr 14 00:13:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Returning 404 to user: Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:13:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5bff9b43-c4e3-418c-852c-43c39010a0cd tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" status: 404 len: 111 microversion: 2.1 time: 0.029330 Apr 14 00:13:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 222/463] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:00 2023] GET /compute/v2.1/servers/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:13:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9c7e312c-016b-4b9f-8f60-ea43880b2286 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Calling method '.version_select at 0x7f3db67a4160>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9c7e312c-016b-4b9f-8f60-ea43880b2286 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540032684" status: 202 len: 0 microversion: 2.1 time: 0.025984 Apr 14 00:13:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 210/464] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:13:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540032684 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-cb98b388-01cb-4330-8e2a-a599fa7ff056 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199703 Apr 14 00:13:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 223/465] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:13:02 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c/os-volume_attachments => generated 25 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:13:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 204 len: 0 microversion: 2.1 time: 0.125369 Apr 14 00:13:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 211/466] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:13:02 2023] DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "name": "network-vif-unplugged", "status": "completed", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:02 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Creating event network-vif-unplugged:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:13:02 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032784 Apr 14 00:13:02 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 212/467] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:02 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e8e9aabf-ccb1-48f0-8d2b-ba8a51520fa1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 200 len: 1666 microversion: 2.1 time: 0.445842 Apr 14 00:13:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 224/468] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:02 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:04 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "name": "network-vif-deleted", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] Creating event network-vif-deleted:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:13:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029110 Apr 14 00:13:04 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 213/469] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:04 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fba4ee-4aae-4ee3-8114-b53510f5442c", "name": "network-vif-plugged", "status": "completed", "tag": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Creating event network-vif-plugged:526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c on user Apr 14 00:13:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037421 Apr 14 00:13:04 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 225/470] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:11 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:11 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-fa74f1c7-1c2d-4be4-97db-2c1e3593aa2b tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1584 microversion: 2.20 time: 0.163175 Apr 14 00:13:11 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 214/471] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:13:11 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1584 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:14 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] HTTP exception thrown: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Request method failure captured: Apr 14 00:13:14 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b HTTP/1.1 Apr 14 00:13:14 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:13:14 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:13:14 user devstack@n-api.service[72774]: Connection: close Apr 14 00:13:14 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:13:14 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:13:14 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:13:14 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:13:14 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJjzSm_6ppmGUSehBjZiqyQFJegBvy-tfCo0P-Dpw-d_1V6N6d25PzNypAOLiNmyPMSpadiQIiCUSbT06QcBJCYq4z-YbD3pAsx-c3KLIkc6zgsnV5ykqAz2T2rKNOonLOWQGDR0cZeAw8rLoH_ZYakXtLmjf5B3B3CUa2XOAnptwjI Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Project-Id: 1f138770c7b4407d83c449500fc000a5 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestStampPattern-1381824337 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Tenant: tempest-TestStampPattern-1381824337 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Tenant-Id: 1f138770c7b4407d83c449500fc000a5 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestStampPattern-1381824337 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-User: tempest-TestStampPattern-1381824337-project-member Apr 14 00:13:14 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:13:14 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:13:14 user devstack@n-api.service[72774]: X-User-Id: 6fe75acb64a94a2a88d370f43fa6b776 Apr 14 00:13:14 user devstack@n-api.service[72774]: X-User-Name: tempest-TestStampPattern-1381824337-project-member Apr 14 00:13:14 user devstack@n-api.service[72774]: method: > Apr 14 00:13:14 user devstack@n-api.service[72774]: exception: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. Apr 14 00:13:14 user devstack@n-api.service[72774]: action_args: {'id': '6fb358a6-7e79-4acf-8fbe-7cc4e67a707b'} Apr 14 00:13:14 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. Apr 14 00:13:14 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:14 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Returning 404 to user: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:13:14 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b1f47bd0-d9a6-471e-b30e-5eb43eef1a00 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" status: 404 len: 111 microversion: 2.1 time: 0.042725 Apr 14 00:13:14 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 226/472] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:14 2023] GET /compute/v2.1/servers/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:15 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8b8f585c-35ed-47b1-baa5-09664563ebed tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1770 microversion: 2.87 time: 0.185214 Apr 14 00:13:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 215/473] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:13:15 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1770 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:13:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-580695201", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "e3acf139-a0c8-4b33-aae5-26131d3dccb5"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:18 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] validate_networks() for [('e3acf139-a0c8-4b33-aae5-26131d3dccb5', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Getting quotas for project 67e9bf71f0644907979ec775c62a0b39. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Getting quotas for user 719f2342cc1d452daae3a4ded790f69a and project 67e9bf71f0644907979ec775c62a0b39. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:13:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:13:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.620407 Apr 14 00:13:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 227/474] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:13:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:13:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a958f896-d2ac-40ee-a6c7-49e1b33c57cc tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:19 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a958f896-d2ac-40ee-a6c7-49e1b33c57cc tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:19 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a958f896-d2ac-40ee-a6c7-49e1b33c57cc tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a958f896-d2ac-40ee-a6c7-49e1b33c57cc tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637" status: 200 len: 1207 microversion: 2.1 time: 0.071687 Apr 14 00:13:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 216/475] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:19 2023] GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637 => generated 1207 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] HTTP exception thrown: Instance 11c3384a-e699-4b10-9f8b-861291e96465 is not attached to volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Request method failure captured: Apr 14 00:13:20 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments/8e63ed78-ec07-4e8f-8ec4-e81494a415a3 HTTP/1.1 Apr 14 00:13:20 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:13:20 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:13:20 user devstack@n-api.service[72774]: Connection: close Apr 14 00:13:20 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:13:20 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:13:20 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:13:20 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:13:20 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJjzSm_6ppmGUSehBjZiqyQFJegBvy-tfCo0P-Dpw-d_1V6N6d25PzNypAOLiNmyPMSpadiQIiCUSbT06QcBJCYq4z-YbD3pAsx-c3KLIkc6zgsnV5ykqAz2T2rKNOonLOWQGDR0cZeAw8rLoH_ZYakXtLmjf5B3B3CUa2XOAnptwjI Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Project-Id: 1f138770c7b4407d83c449500fc000a5 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestStampPattern-1381824337 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Tenant: tempest-TestStampPattern-1381824337 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Tenant-Id: 1f138770c7b4407d83c449500fc000a5 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestStampPattern-1381824337 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-User: tempest-TestStampPattern-1381824337-project-member Apr 14 00:13:20 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:13:20 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:13:20 user devstack@n-api.service[72774]: X-User-Id: 6fe75acb64a94a2a88d370f43fa6b776 Apr 14 00:13:20 user devstack@n-api.service[72774]: X-User-Name: tempest-TestStampPattern-1381824337-project-member Apr 14 00:13:20 user devstack@n-api.service[72774]: method: > Apr 14 00:13:20 user devstack@n-api.service[72774]: exception: Instance 11c3384a-e699-4b10-9f8b-861291e96465 is not attached to volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 Apr 14 00:13:20 user devstack@n-api.service[72774]: action_args: {'server_id': '11c3384a-e699-4b10-9f8b-861291e96465', 'id': '8e63ed78-ec07-4e8f-8ec4-e81494a415a3'} Apr 14 00:13:20 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8e63ed78-ec07-4e8f-8ec4-e81494a415a3. Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c3384a-e699-4b10-9f8b-861291e96465 is not attached to volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c3384a-e699-4b10-9f8b-861291e96465 is not attached to volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 Apr 14 00:13:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Returning 404 to user: Instance 11c3384a-e699-4b10-9f8b-861291e96465 is not attached to volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:13:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-aa31f77e-27f7-4819-9941-2fc2e9511480 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments/8e63ed78-ec07-4e8f-8ec4-e81494a415a3" status: 404 len: 154 microversion: 2.1 time: 0.190250 Apr 14 00:13:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 228/476] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:13:20 2023] DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465/os-volume_attachments/8e63ed78-ec07-4e8f-8ec4-e81494a415a3 => generated 154 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Creating event network-changed:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:13:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:13:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032183 Apr 14 00:13:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 229/477] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465" status: 204 len: 0 microversion: 2.1 time: 0.127668 Apr 14 00:13:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 217/478] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:13:20 2023] DELETE /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:21 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-60a48803-e064-4d24-b02c-9d959b0d931b tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465" status: 200 len: 1662 microversion: 2.1 time: 0.329355 Apr 14 00:13:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 230/479] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:21 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 => generated 1662 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "name": "network-vif-unplugged", "status": "completed", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Creating event network-vif-unplugged:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:13:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033750 Apr 14 00:13:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 218/480] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "name": "network-vif-deleted", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] Creating event network-vif-deleted:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:13:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041638 Apr 14 00:13:22 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 231/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c3384a-e699-4b10-9f8b-861291e96465", "name": "network-vif-plugged", "status": "completed", "tag": "cce0e09c-d491-4698-b846-d75a670cc38e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Creating event network-vif-plugged:cce0e09c-d491-4698-b846-d75a670cc38e for instance 11c3384a-e699-4b10-9f8b-861291e96465 on user Apr 14 00:13:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Apr 14 00:13:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 219/482] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13860c45-6a4b-48ea-9d0f-d50656585637", "tag": "d102c4a9-79bd-4968-9a16-9eedcbce0056"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Creating event network-changed:d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance 13860c45-6a4b-48ea-9d0f-d50656585637 on user Apr 14 00:13:24 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029612 Apr 14 00:13:24 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 232/483] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:26 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13860c45-6a4b-48ea-9d0f-d50656585637", "name": "network-vif-plugged", "status": "completed", "tag": "d102c4a9-79bd-4968-9a16-9eedcbce0056"}, {"server_uuid": "13860c45-6a4b-48ea-9d0f-d50656585637", "name": "network-vif-plugged", "status": "completed", "tag": "d102c4a9-79bd-4968-9a16-9eedcbce0056"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:26 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:26 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Creating event network-vif-plugged:d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance 13860c45-6a4b-48ea-9d0f-d50656585637 on user Apr 14 00:13:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Creating event network-vif-plugged:d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance 13860c45-6a4b-48ea-9d0f-d50656585637 on user Apr 14 00:13:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037018 Apr 14 00:13:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 220/484] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:29 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=46 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a82533ab-755f-41a3-82ea-e63798a83f5d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1652 microversion: 2.1 time: 0.211182 Apr 14 00:13:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 233/485] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:28 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1652 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-749728094", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] validate_networks() for None {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Getting quotas for project 3d9d27c26e8e4b529040d8909aec1a04. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Getting quotas for user bb07ce4305014dfaacd6283e4fcab068 and project 3d9d27c26e8e4b529040d8909aec1a04. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:13:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.459735 Apr 14 00:13:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 221/486] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:13:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:13:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-afa68b7f-29b6-49f1-b0ed-f168e4e72670 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:37 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-afa68b7f-29b6-49f1-b0ed-f168e4e72670 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:37 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:37 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4270bff4-1d2a-4b37-8624-ee675fa9061d"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:37 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-afa68b7f-29b6-49f1-b0ed-f168e4e72670 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb07ce4305014dfaacd6283e4fcab068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d27c26e8e4b529040d8909aec1a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-afa68b7f-29b6-49f1-b0ed-f168e4e72670 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7" status: 200 len: 1208 microversion: 2.1 time: 0.097548 Apr 14 00:13:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 234/487] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:37 2023] GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => generated 1208 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] HTTP exception thrown: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Request method failure captured: Apr 14 00:13:37 user devstack@n-api.service[72773]: request: PUT /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008/os-volume_attachments/41159c2e-a884-4d74-b88a-d5a724103c19 HTTP/1.1 Apr 14 00:13:37 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:13:37 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:13:37 user devstack@n-api.service[72773]: Connection: close Apr 14 00:13:37 user devstack@n-api.service[72773]: Content-Length: 74 Apr 14 00:13:37 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:13:37 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:13:37 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:13:37 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJmORAx8rtYyMUMLU-omS_PdYspL_nR42e0SaAgVJOAHMoz2Cmzvnt4HxyC7f333H7eLYR0CXI64vR-N1LoaegXzTDaVYor2-RyA0fgLJJuboOpZBSuMmZtwL-sjF9b9h4WBmkgW_WszdWm2lkTU4CT6UPsHDl59TtLb7RAXSS6BnUI Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Project-Id: 0c091ccd8062479083a0a8b6ec25a48c Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesAdminNegativeTest-91805723 Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Role: member,reader,admin Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Roles: member,reader,admin Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c091ccd8062479083a0a8b6ec25a48c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c091ccd8062479083a0a8b6ec25a48c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c091ccd8062479083a0a8b6ec25a48c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesAdminNegativeTest-91805723 Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Tenant-Id: 0c091ccd8062479083a0a8b6ec25a48c Apr 14 00:13:37 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-91805723 Apr 14 00:13:37 user devstack@n-api.service[72773]: X-User: tempest-VolumesAdminNegativeTest-91805723-project-admin Apr 14 00:13:37 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:13:37 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:13:37 user devstack@n-api.service[72773]: X-User-Id: 8fe936f560b743f496208d0ea2ae67cb Apr 14 00:13:37 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesAdminNegativeTest-91805723-project-admin Apr 14 00:13:37 user devstack@n-api.service[72773]: Apr 14 00:13:37 user devstack@n-api.service[72773]: {"volumeAttachment": {"volumeId": "4270bff4-1d2a-4b37-8624-ee675fa9061d"}} Apr 14 00:13:37 user devstack@n-api.service[72773]: method: > Apr 14 00:13:37 user devstack@n-api.service[72773]: exception: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. Apr 14 00:13:37 user devstack@n-api.service[72773]: action_args: {'server_id': '493c65ce-aceb-4273-926e-d3633e676008', 'id': '41159c2e-a884-4d74-b88a-d5a724103c19', 'body': {'volumeAttachment': {'volumeId': '4270bff4-1d2a-4b37-8624-ee675fa9061d'}}} Apr 14 00:13:37 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. (HTTP 404) (Request-ID: req-7468c8d2-0868-49bb-bd63-d627ddd69110) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. Apr 14 00:13:37 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] Returning 404 to user: Volume 41159c2e-a884-4d74-b88a-d5a724103c19 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:13:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-cfecbfe5-c6fa-4b99-a4d2-be4447999322 tempest-VolumesAdminNegativeTest-91805723 tempest-VolumesAdminNegativeTest-91805723-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008/os-volume_attachments/41159c2e-a884-4d74-b88a-d5a724103c19" status: 404 len: 109 microversion: 2.1 time: 0.111493 Apr 14 00:13:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 222/488] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 00:13:37 2023] PUT /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008/os-volume_attachments/41159c2e-a884-4d74-b88a-d5a724103c19 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:39 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1fd78961-de6f-4f42-ac06-f677d617cf8e tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1504 microversion: 2.1 time: 0.279142 Apr 14 00:13:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 235/489] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:39 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7553ffb8-704b-4b9c-8a15-13357f4ac9e7", "tag": "b4182f27-1858-4ce4-abfb-83ccbc0ac556"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Creating event network-changed:b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 on user Apr 14 00:13:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029813 Apr 14 00:13:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 223/490] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:13:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008" status: 204 len: 0 microversion: 2.1 time: 0.135946 Apr 14 00:13:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 236/491] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:13:40 2023] DELETE /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493c65ce-aceb-4273-926e-d3633e676008", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Creating event network-vif-unplugged:6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance 493c65ce-aceb-4273-926e-d3633e676008 on user Apr 14 00:13:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049318 Apr 14 00:13:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 237/492] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:41 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8b639be3-0d70-4c81-b47c-70c575f218c3 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008" status: 200 len: 1502 microversion: 2.1 time: 0.349633 Apr 14 00:13:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 224/493] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:41 2023] GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008 => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493c65ce-aceb-4273-926e-d3633e676008", "name": "network-vif-deleted", "tag": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] Creating event network-vif-deleted:6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance 493c65ce-aceb-4273-926e-d3633e676008 on user Apr 14 00:13:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034821 Apr 14 00:13:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 238/494] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493c65ce-aceb-4273-926e-d3633e676008", "name": "network-vif-plugged", "status": "completed", "tag": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Creating event network-vif-plugged:6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance 493c65ce-aceb-4273-926e-d3633e676008 on user Apr 14 00:13:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Apr 14 00:13:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 225/495] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7553ffb8-704b-4b9c-8a15-13357f4ac9e7", "name": "network-vif-plugged", "status": "completed", "tag": "b4182f27-1858-4ce4-abfb-83ccbc0ac556"}, {"server_uuid": "7553ffb8-704b-4b9c-8a15-13357f4ac9e7", "name": "network-vif-plugged", "status": "completed", "tag": "b4182f27-1858-4ce4-abfb-83ccbc0ac556"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Creating event network-vif-plugged:b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 on user Apr 14 00:13:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Creating event network-vif-plugged:b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 on user Apr 14 00:13:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031845 Apr 14 00:13:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 239/496] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:13:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-fc9796bf-31fb-483b-a8e9-93d7a065ca2a tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1677 microversion: 2.1 time: 0.192573 Apr 14 00:13:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 226/497] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:49 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94d1d134-5857-4a7c-bf52-bd818e828f3e"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302489 Apr 14 00:13:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 240/498] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:13:49 2023] POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:13:53 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c HTTP/1.1 Apr 14 00:13:53 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:13:53 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:13:53 user devstack@n-api.service[72773]: Connection: close Apr 14 00:13:53 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:13:53 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:13:53 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:13:53 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:13:53 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:13:53 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:13:53 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:13:53 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:13:53 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:13:53 user devstack@n-api.service[72773]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:13:53 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:13:53 user devstack@n-api.service[72773]: method: > Apr 14 00:13:53 user devstack@n-api.service[72773]: exception: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:13:53 user devstack@n-api.service[72773]: action_args: {'id': 'e3fba4ee-4aae-4ee3-8114-b53510f5442c'} Apr 14 00:13:53 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:13:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:13:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-95c4140f-7938-4109-a0cd-c0385454fe04 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 404 len: 111 microversion: 2.1 time: 0.028147 Apr 14 00:13:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 227/499] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:53 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:13:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c56d8400-5e21-4600-8ca9-acdb64754123 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '.version_select at 0x7f3db66bbe20>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c56d8400-5e21-4600-8ca9-acdb64754123 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-911498178" status: 202 len: 0 microversion: 2.1 time: 0.023780 Apr 14 00:13:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 241/500] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 00:13:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-911498178 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c86fbb87-30a0-4f97-8990-1b65f412f956 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: .version_select at 0x7f3db67a40d0>, body: {"keypair": {"name": "tempest-keypair-1854176898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGkLOYcKKntXB8xBUrq5TfkCx1/xNQj4Ksi6k+fzjiqYC04ZpG2CZF3KkB+DY5NBDh2NzjAuCSlSRLBIT2B1CwX+AbHx15ScaMmXWoEIRyWreJeS2PAr2D8ysrfPRBoiQ=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-c86fbb87-30a0-4f97-8990-1b65f412f956 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:13:53 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-c86fbb87-30a0-4f97-8990-1b65f412f956 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:13:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c86fbb87-30a0-4f97-8990-1b65f412f956 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075147 Apr 14 00:13:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 228/501] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:13:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247623601", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6d80f923-8aef-45df-921b-f77ed4ff0e75"}], "security_groups": [{"name": "tempest-securitygroup--1600048524"}], "key_name": "tempest-keypair-1854176898", "user_data": "}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] validate_networks() for [('6d80f923-8aef-45df-921b-f77ed4ff0e75', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:13:56 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:13:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.730299 Apr 14 00:13:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 242/502] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:13:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:13:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-78178017-931a-4bd7-a492-f2953cb3f847 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:56 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-78178017-931a-4bd7-a492-f2953cb3f847 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:56 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-78178017-931a-4bd7-a492-f2953cb3f847 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-78178017-931a-4bd7-a492-f2953cb3f847 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 200 len: 1236 microversion: 2.1 time: 0.100332 Apr 14 00:13:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 229/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:56 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Old instance type m1.nano, new instance type m1.micro {{(pid=72774) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:13:57 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:13:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/action" status: 202 len: 0 microversion: 2.1 time: 0.576507 Apr 14 00:13:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 243/504] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:13:57 2023] POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:13:58 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:13:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-98578738-0dfe-42ec-9d8b-a8975f26b7e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1732 microversion: 2.1 time: 0.354947 Apr 14 00:13:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 230/505] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:13:58 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1732 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:00 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Creating event network-changed:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:14:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039459 Apr 14 00:14:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 244/506] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:14:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-unplugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Creating event network-vif-unplugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:14:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72773) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:14:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066966 Apr 14 00:14:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 231/507] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:03 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "name": "network-vif-plugged", "status": "completed", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Creating event network-vif-plugged:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:14:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044889 Apr 14 00:14:03 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 245/508] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:14:03 user devstack@n-api.service[72773]: DEBUG nova.compute.api [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72773) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:14:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037016 Apr 14 00:14:03 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 232/509] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "name": "network-vif-plugged", "status": "completed", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Creating event network-vif-plugged:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:14:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033533 Apr 14 00:14:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 246/510] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=39 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:09 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9fc1b026-e128-4a1d-9920-4d87e01c5b2f tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637" status: 200 len: 1485 microversion: 2.1 time: 0.179442 Apr 14 00:14:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 233/511] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:09 2023] GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637 => generated 1485 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=5 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] HTTP exception thrown: Instance 11c3384a-e699-4b10-9f8b-861291e96465 could not be found. Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Request method failure captured: Apr 14 00:14:11 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 HTTP/1.1 Apr 14 00:14:11 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:14:11 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:14:11 user devstack@n-api.service[72774]: Connection: close Apr 14 00:14:11 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:14:11 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:14:11 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:14:11 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:14:11 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJjzSm_6ppmGUSehBjZiqyQFJegBvy-tfCo0P-Dpw-d_1V6N6d25PzNypAOLiNmyPMSpadiQIiCUSbT06QcBJCYq4z-YbD3pAsx-c3KLIkc6zgsnV5ykqAz2T2rKNOonLOWQGDR0cZeAw8rLoH_ZYakXtLmjf5B3B3CUa2XOAnptwjI Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Project-Id: 1f138770c7b4407d83c449500fc000a5 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestStampPattern-1381824337 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f138770c7b4407d83c449500fc000a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Tenant: tempest-TestStampPattern-1381824337 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Tenant-Id: 1f138770c7b4407d83c449500fc000a5 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestStampPattern-1381824337 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-User: tempest-TestStampPattern-1381824337-project-member Apr 14 00:14:11 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:14:11 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:14:11 user devstack@n-api.service[72774]: X-User-Id: 6fe75acb64a94a2a88d370f43fa6b776 Apr 14 00:14:11 user devstack@n-api.service[72774]: X-User-Name: tempest-TestStampPattern-1381824337-project-member Apr 14 00:14:11 user devstack@n-api.service[72774]: method: > Apr 14 00:14:11 user devstack@n-api.service[72774]: exception: Instance 11c3384a-e699-4b10-9f8b-861291e96465 could not be found. Apr 14 00:14:11 user devstack@n-api.service[72774]: action_args: {'id': '11c3384a-e699-4b10-9f8b-861291e96465'} Apr 14 00:14:11 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c3384a-e699-4b10-9f8b-861291e96465 could not be found. Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c3384a-e699-4b10-9f8b-861291e96465 could not be found. Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c3384a-e699-4b10-9f8b-861291e96465 could not be found. Apr 14 00:14:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Returning 404 to user: Instance 11c3384a-e699-4b10-9f8b-861291e96465 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:14:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3cf3f07a-1c96-448f-a478-d056f6be3e0f tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465" status: 404 len: 111 microversion: 2.1 time: 0.034446 Apr 14 00:14:11 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 247/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:11 2023] GET /compute/v2.1/servers/11c3384a-e699-4b10-9f8b-861291e96465 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2ddfb38f-ea4a-496e-b917-acaa470e5392 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.091742 Apr 14 00:14:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 234/513] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 00:14:12 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-interface => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:14:13 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Creating event network-changed:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:14:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074921 Apr 14 00:14:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 248/514] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:13 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f207553a-b65c-4af6-b431-07a066e4eb6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/ips" status: 200 len: 108 microversion: 2.20 time: 0.065408 Apr 14 00:14:13 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 235/515] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 00:14:13 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/ips => generated 108 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0147bd0c-9a15-4fba-a659-c2a9d5c61645 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Calling method '.version_select at 0x7f3db6919cf0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0147bd0c-9a15-4fba-a659-c2a9d5c61645 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-2105733066" status: 202 len: 0 microversion: 2.1 time: 0.023899 Apr 14 00:14:15 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 249/516] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:14:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-2105733066 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:15 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'flavor' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}, {"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:14:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG nova.compute.api [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:14:15 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057949 Apr 14 00:14:15 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 250/517] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1903424874", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "491696ea-38ef-4c19-9d94-a61223c1fa00"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:15 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] validate_networks() for [('491696ea-38ef-4c19-9d94-a61223c1fa00', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:14:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/action" status: 202 len: 0 microversion: 2.20 time: 0.943474 Apr 14 00:14:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 236/518] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:14:15 2023] POST /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-051290d2-14a0-4e76-9291-bbcb6b400dca tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1708 microversion: 2.20 time: 0.405767 Apr 14 00:14:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 237/519] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:14:16 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1708 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-unplugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Creating event network-vif-unplugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:14:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034272 Apr 14 00:14:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 238/520] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for user 90bad96535c3453792982c5acab9dbc6 and project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:14:16 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:14:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.046820 Apr 14 00:14:16 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 251/521] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:14:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4f93c77c-6ec8-4f30-9dea-3e15da8b7421 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4f93c77c-6ec8-4f30-9dea-3e15da8b7421 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:17 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4f93c77c-6ec8-4f30-9dea-3e15da8b7421 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:17 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4f93c77c-6ec8-4f30-9dea-3e15da8b7421 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:17 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4f93c77c-6ec8-4f30-9dea-3e15da8b7421 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:17 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4f93c77c-6ec8-4f30-9dea-3e15da8b7421 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb" status: 200 len: 1395 microversion: 2.87 time: 0.119867 Apr 14 00:14:17 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 239/522] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:14:16 2023] GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb => generated 1395 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:14:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-plugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Creating event network-vif-plugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:14:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034369 Apr 14 00:14:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 252/523] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2793d412-f405-4452-8e46-c192e3c92ccb", "tag": "47e07f85-3946-4934-a2ec-c9c77ccc3761"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Creating event network-changed:47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance 2793d412-f405-4452-8e46-c192e3c92ccb on user Apr 14 00:14:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033280 Apr 14 00:14:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 240/524] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Creating event network-changed:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:14:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043358 Apr 14 00:14:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 253/525] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:24 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2793d412-f405-4452-8e46-c192e3c92ccb", "name": "network-vif-plugged", "status": "completed", "tag": "47e07f85-3946-4934-a2ec-c9c77ccc3761"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Creating event network-vif-plugged:47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance 2793d412-f405-4452-8e46-c192e3c92ccb on user Apr 14 00:14:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Apr 14 00:14:24 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 241/526] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:26 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2793d412-f405-4452-8e46-c192e3c92ccb", "name": "network-vif-plugged", "status": "completed", "tag": "47e07f85-3946-4934-a2ec-c9c77ccc3761"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Creating event network-vif-plugged:47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance 2793d412-f405-4452-8e46-c192e3c92ccb on user Apr 14 00:14:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055037 Apr 14 00:14:26 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 254/527] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:27 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb07ce4305014dfaacd6283e4fcab068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d27c26e8e4b529040d8909aec1a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a2b5c52b-2ab9-494b-8c5c-5a504bfacfd8 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7" status: 200 len: 1454 microversion: 2.1 time: 0.169660 Apr 14 00:14:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 242/528] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:27 2023] GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-10779343-1161-4458-9c0e-77cbe18a8bca tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052729 Apr 14 00:14:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 255/529] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:14:29 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:14:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 204 len: 0 microversion: 2.1 time: 0.106359 Apr 14 00:14:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 243/530] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:14:29 2023] DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-42842796-e6de-4da6-8e71-2a2ff4028eb0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 200 len: 1658 microversion: 2.1 time: 0.219421 Apr 14 00:14:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 256/531] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:29 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 1658 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-unplugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Creating event network-vif-unplugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:14:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031039 Apr 14 00:14:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 244/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] HTTP exception thrown: Instance 493c65ce-aceb-4273-926e-d3633e676008 could not be found. Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Request method failure captured: Apr 14 00:14:31 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008 HTTP/1.1 Apr 14 00:14:31 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:14:31 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:14:31 user devstack@n-api.service[72774]: Connection: close Apr 14 00:14:31 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:14:31 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:14:31 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:14:31 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:14:31 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJmFGjesVtucW3-JXwTKkLJcZ36sNLnQsW2Rtos-Uie6lsxGOWn_eXpvyxEfviOTsMeCN33NLuQvyUkUqo8opIhjPnjSJO7zOXliPfUFAvysilPu1dnlRsiwgCg0gm1jsOHCcbhU-J4lPoK_iivJN3rZosE6tGLJsim-tVryljTKE1c Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Project-Id: dffbe999e60a4add9f23c83f9b0a4252 Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesAdminNegativeTest-1377720460 Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dffbe999e60a4add9f23c83f9b0a4252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dffbe999e60a4add9f23c83f9b0a4252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dffbe999e60a4add9f23c83f9b0a4252"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesAdminNegativeTest-1377720460 Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Tenant-Id: dffbe999e60a4add9f23c83f9b0a4252 Apr 14 00:14:31 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1377720460 Apr 14 00:14:31 user devstack@n-api.service[72774]: X-User: tempest-VolumesAdminNegativeTest-1377720460-project-member Apr 14 00:14:31 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:14:31 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:14:31 user devstack@n-api.service[72774]: X-User-Id: 74d7e3d598e74c288e6a44996303b85e Apr 14 00:14:31 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesAdminNegativeTest-1377720460-project-member Apr 14 00:14:31 user devstack@n-api.service[72774]: method: > Apr 14 00:14:31 user devstack@n-api.service[72774]: exception: Instance 493c65ce-aceb-4273-926e-d3633e676008 could not be found. Apr 14 00:14:31 user devstack@n-api.service[72774]: action_args: {'id': '493c65ce-aceb-4273-926e-d3633e676008'} Apr 14 00:14:31 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493c65ce-aceb-4273-926e-d3633e676008 could not be found. Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493c65ce-aceb-4273-926e-d3633e676008 could not be found. Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493c65ce-aceb-4273-926e-d3633e676008 could not be found. Apr 14 00:14:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:14:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Returning 404 to user: Instance 493c65ce-aceb-4273-926e-d3633e676008 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:14:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-873aff4e-298f-449f-9240-aae054369e8c tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008" status: 404 len: 111 microversion: 2.1 time: 0.379278 Apr 14 00:14:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 257/533] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:31 2023] GET /compute/v2.1/servers/493c65ce-aceb-4273-926e-d3633e676008 => generated 111 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:14:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-plugged", "status": "completed", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}, {"server_uuid": "01a65362-36ea-4817-8e83-f75d6daf808b", "name": "network-vif-deleted", "tag": "b5dfa187-0a42-4319-990f-1d3b22691c27"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Creating event network-vif-plugged:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:14:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Creating event network-vif-deleted:b5dfa187-0a42-4319-990f-1d3b22691c27 for instance 01a65362-36ea-4817-8e83-f75d6daf808b on user Apr 14 00:14:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053004 Apr 14 00:14:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 245/534] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:14:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05" status: 204 len: 0 microversion: 2.1 time: 0.120382 Apr 14 00:14:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 258/535] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:14:35 2023] DELETE /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:35 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-39ebe278-5ba2-4798-9a8c-c971e4cd6368 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05" status: 200 len: 1671 microversion: 2.1 time: 0.224105 Apr 14 00:14:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 246/536] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:35 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05 => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "name": "network-vif-unplugged", "status": "completed", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Creating event network-vif-unplugged:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:14:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043520 Apr 14 00:14:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 259/537] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "name": "network-vif-deleted", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] Creating event network-vif-deleted:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:14:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Apr 14 00:14:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 247/538] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feba40a-03c7-4c60-b862-ee14fb8c9b05", "name": "network-vif-plugged", "status": "completed", "tag": "53562eeb-b1fd-47f1-896e-cacd277abf24"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Creating event network-vif-plugged:53562eeb-b1fd-47f1-896e-cacd277abf24 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 on user Apr 14 00:14:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027342 Apr 14 00:14:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 260/539] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:41 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:14:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/action" status: 200 len: 32 microversion: 2.1 time: 0.108932 Apr 14 00:14:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 248/540] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:14:41 2023] POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/action => generated 32 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:42 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-645b8eb3-0b63-4b72-9435-f72eb673a2d3 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1510 microversion: 2.1 time: 0.740660 Apr 14 00:14:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 261/541] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:41 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1510 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-unplugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Creating event network-vif-unplugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029917 Apr 14 00:14:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 249/542] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}, {"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}, {"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}, {"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-unplugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}, {"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:44 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Creating event network-vif-unplugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033358 Apr 14 00:14:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 262/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}, {"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:14:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:14:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028848 Apr 14 00:14:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 250/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:47 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-587045ff-feca-4fd8-8d40-e66e63758cdd tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 200 len: 1545 microversion: 2.1 time: 0.251762 Apr 14 00:14:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 263/545] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:46 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 1545 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:14:48 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:14:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1940aa47-df8f-4682-881f-7981fc0f8d4e tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1731 microversion: 2.1 time: 0.144836 Apr 14 00:14:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 251/546] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:14:48 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=7 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:06 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-87378f86-e440-4e3c-808f-1c3ee7335e4a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1649 microversion: 2.20 time: 0.366002 Apr 14 00:15:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 264/547] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:15:06 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1649 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=7 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:07 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4ba8c124-bcbb-488d-b50c-ce5ffcae3f53 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb" status: 200 len: 1692 microversion: 2.87 time: 0.235020 Apr 14 00:15:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 252/548] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:15:07 2023] GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb => generated 1692 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:15:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637" status: 204 len: 0 microversion: 2.1 time: 0.123152 Apr 14 00:15:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 265/549] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:15:10 2023] DELETE /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:10 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ad16419f-c9cd-4a51-8f34-8e60416ad8e7 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637" status: 200 len: 1491 microversion: 2.1 time: 0.247560 Apr 14 00:15:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 253/550] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:10 2023] GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637 => generated 1491 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13860c45-6a4b-48ea-9d0f-d50656585637", "name": "network-vif-unplugged", "status": "completed", "tag": "d102c4a9-79bd-4968-9a16-9eedcbce0056"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Creating event network-vif-unplugged:d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance 13860c45-6a4b-48ea-9d0f-d50656585637 on user Apr 14 00:15:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133771 Apr 14 00:15:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 266/551] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13860c45-6a4b-48ea-9d0f-d50656585637", "name": "network-vif-plugged", "status": "completed", "tag": "d102c4a9-79bd-4968-9a16-9eedcbce0056"}, {"server_uuid": "13860c45-6a4b-48ea-9d0f-d50656585637", "name": "network-vif-deleted", "tag": "d102c4a9-79bd-4968-9a16-9eedcbce0056"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Creating event network-vif-plugged:d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance 13860c45-6a4b-48ea-9d0f-d50656585637 on user Apr 14 00:15:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Creating event network-vif-deleted:d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance 13860c45-6a4b-48ea-9d0f-d50656585637 on user Apr 14 00:15:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029748 Apr 14 00:15:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 254/552] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HTTP exception thrown: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Request method failure captured: Apr 14 00:15:19 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b HTTP/1.1 Apr 14 00:15:19 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:15:19 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:15:19 user devstack@n-api.service[72774]: Connection: close Apr 14 00:15:19 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:15:19 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:15:19 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:15:19 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:15:19 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiiCW40gNsPTEFpiH3tK2APNFm2AIrjR32585IITKD-JgH-2ACUHwcBEyasPnw5FFAA__ChIbvWU4mGRgnt7ZwMMKcl6j7lrz9vO3m8APuHZTVt1EX5g97E8kB2cSOJFb03o69rO_YNHX7dHXjuXjLJwO5HQQizFPuwmcguuONtmIg Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Project-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Tenant-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:15:19 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:15:19 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:15:19 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:15:19 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:15:19 user devstack@n-api.service[72774]: X-User-Id: 44530987616b417d87ce5909d8de1871 Apr 14 00:15:19 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:15:19 user devstack@n-api.service[72774]: method: > Apr 14 00:15:19 user devstack@n-api.service[72774]: exception: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:15:19 user devstack@n-api.service[72774]: action_args: {'id': '01a65362-36ea-4817-8e83-f75d6daf808b'} Apr 14 00:15:19 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:15:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:15:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Returning 404 to user: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:15:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e297308e-e772-43e5-8d95-1c5e446e4a7a tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 404 len: 111 microversion: 2.1 time: 0.032855 Apr 14 00:15:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 267/553] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:19 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:15:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3cc52e55-087e-455a-9d23-0b79aa82e75c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '.version_select at 0x7f3db666b490>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3cc52e55-087e-455a-9d23-0b79aa82e75c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608426082" status: 202 len: 0 microversion: 2.1 time: 0.022505 Apr 14 00:15:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 255/554] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 00:15:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608426082 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:15:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d98de6bd-46fc-42ea-b788-0c2e0b809af6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: .version_select at 0x7f3db691b370>, body: {"keypair": {"name": "tempest-keypair-1596000720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeu3sLSv8MjRHlPE0XtJ4rNeSiWhefKhtVNlkDogqACZkiI1sdRyNSDtHyBnSkkNhIwyCmjqAmbXkqQdo4qEaGe/zgoUlWHrCvPiCy5gC+LrtY/wQVkC2HqO/3lmIrXQw=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:20 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-d98de6bd-46fc-42ea-b788-0c2e0b809af6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:15:20 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-d98de6bd-46fc-42ea-b788-0c2e0b809af6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for user 44530987616b417d87ce5909d8de1871 and project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:15:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d98de6bd-46fc-42ea-b788-0c2e0b809af6 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044122 Apr 14 00:15:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 268/555] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:15:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1072577782", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "368d9445-850e-4f74-b5cc-86d1eaa95d63"}], "security_groups": [{"name": "tempest-securitygroup--1122749277"}], "key_name": "tempest-keypair-1596000720", "user_data": "}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:22 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] validate_networks() for [('368d9445-850e-4f74-b5cc-86d1eaa95d63', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:15:22 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=14 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting quotas for user 44530987616b417d87ce5909d8de1871 and project ec1aab0338ff4bd195a37a4199a378eb. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:15:23 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:15:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.628931 Apr 14 00:15:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 256/556] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:15:22 2023] POST /compute/v2.1/servers => generated 400 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:15:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-392d16c4-ca00-413e-9d2b-eb7f16aea324 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:23 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-392d16c4-ca00-413e-9d2b-eb7f16aea324 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:23 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-392d16c4-ca00-413e-9d2b-eb7f16aea324 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-392d16c4-ca00-413e-9d2b-eb7f16aea324 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 200 len: 1232 microversion: 2.1 time: 0.069143 Apr 14 00:15:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 269/557] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:23 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 1232 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] HTTP exception thrown: Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 could not be found. Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Request method failure captured: Apr 14 00:15:25 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05 HTTP/1.1 Apr 14 00:15:25 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:15:25 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:15:25 user devstack@n-api.service[72773]: Connection: close Apr 14 00:15:25 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:15:25 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:15:25 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:15:25 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:15:25 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJmFGjesVtucW3-JXwTKkLJcZ36sNLnQsW2Rtos-Uie6lsxGOWn_eXpvyxEfviOTsMeCN33NLuQvyUkUqo8opIhjPnjSJO7zOXliPfUFAvysilPu1dnlRsiwgCg0gm1jsOHCcbhU-J4lPoK_iivJN3rZosE6tGLJsim-tVryljTKE1c Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Project-Id: dffbe999e60a4add9f23c83f9b0a4252 Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesAdminNegativeTest-1377720460 Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dffbe999e60a4add9f23c83f9b0a4252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dffbe999e60a4add9f23c83f9b0a4252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dffbe999e60a4add9f23c83f9b0a4252"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesAdminNegativeTest-1377720460 Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Tenant-Id: dffbe999e60a4add9f23c83f9b0a4252 Apr 14 00:15:25 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1377720460 Apr 14 00:15:25 user devstack@n-api.service[72773]: X-User: tempest-VolumesAdminNegativeTest-1377720460-project-member Apr 14 00:15:25 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:15:25 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:15:25 user devstack@n-api.service[72773]: X-User-Id: 74d7e3d598e74c288e6a44996303b85e Apr 14 00:15:25 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesAdminNegativeTest-1377720460-project-member Apr 14 00:15:25 user devstack@n-api.service[72773]: method: > Apr 14 00:15:25 user devstack@n-api.service[72773]: exception: Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 could not be found. Apr 14 00:15:25 user devstack@n-api.service[72773]: action_args: {'id': '8feba40a-03c7-4c60-b862-ee14fb8c9b05'} Apr 14 00:15:25 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 could not be found. Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 could not be found. Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 could not be found. Apr 14 00:15:25 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Returning 404 to user: Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:15:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9a18331b-fe1f-4199-9993-32392f2c2a5d tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05" status: 404 len: 111 microversion: 2.1 time: 0.047835 Apr 14 00:15:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 257/558] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:25 2023] GET /compute/v2.1/servers/8feba40a-03c7-4c60-b862-ee14fb8c9b05 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:15:25 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e142d899-b883-47a0-9455-e5a0a0012d3a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Calling method '.version_select at 0x7f3db691bb50>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e142d899-b883-47a0-9455-e5a0a0012d3a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912277882" status: 202 len: 0 microversion: 2.1 time: 0.019813 Apr 14 00:15:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 270/559] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:15:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912277882 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Creating event network-changed:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:15:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030970 Apr 14 00:15:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 258/560] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:15:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7" status: 204 len: 0 microversion: 2.1 time: 0.139964 Apr 14 00:15:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 271/561] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:15:27 2023] DELETE /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Creating event network-vif-plugged:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:15:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 Apr 14 00:15:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 272/562] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7553ffb8-704b-4b9c-8a15-13357f4ac9e7", "name": "network-vif-unplugged", "status": "completed", "tag": "b4182f27-1858-4ce4-abfb-83ccbc0ac556"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Creating event network-vif-unplugged:b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 on user Apr 14 00:15:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039285 Apr 14 00:15:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 273/563] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:15:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb07ce4305014dfaacd6283e4fcab068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d27c26e8e4b529040d8909aec1a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3dfcad67-8dae-4da6-883f-526cd85dafb9 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7" status: 200 len: 1460 microversion: 2.1 time: 0.449896 Apr 14 00:15:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 259/564] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:28 2023] GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => generated 1460 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:15:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Creating event network-vif-plugged:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:15:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029779 Apr 14 00:15:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 274/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7553ffb8-704b-4b9c-8a15-13357f4ac9e7", "name": "network-vif-plugged", "status": "completed", "tag": "b4182f27-1858-4ce4-abfb-83ccbc0ac556"}, {"server_uuid": "7553ffb8-704b-4b9c-8a15-13357f4ac9e7", "name": "network-vif-deleted", "tag": "b4182f27-1858-4ce4-abfb-83ccbc0ac556"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Creating event network-vif-plugged:b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 on user Apr 14 00:15:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Creating event network-vif-deleted:b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 on user Apr 14 00:15:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052259 Apr 14 00:15:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 260/566] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:32 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-392d0ae1-1b93-4121-822d-32b6054daa37 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1490 microversion: 2.1 time: 0.546187 Apr 14 00:15:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 275/567] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:32 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1490 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=14 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-29df657d-48be-4441-9eb7-a0eec6cc8720 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.161528 Apr 14 00:15:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 261/568] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:15:47 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Creating event network-changed:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:15:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Apr 14 00:15:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 262/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-565c26b9-3a86-4c20-87ea-e2a554d5495d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/ips" status: 200 len: 107 microversion: 2.1 time: 0.039450 Apr 14 00:15:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 263/570] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:15:48 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/ips => generated 107 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/action" status: 202 len: 0 microversion: 2.1 time: 0.212607 Apr 14 00:15:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 276/571] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:15:48 2023] POST /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:15:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bca48e99-1428-45b4-b009-6893bc22ea97 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1730 microversion: 2.1 time: 0.389843 Apr 14 00:15:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 264/572] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:15:48 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1730 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304120 Apr 14 00:15:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 277/573] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:15:50 2023] POST /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-unplugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Creating event network-vif-unplugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:15:50 user devstack@n-api.service[72773]: DEBUG nova.compute.api [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72773) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:15:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166393 Apr 14 00:15:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 265/574] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:15:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:15:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039851 Apr 14 00:15:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 278/575] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:15:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Invalid volume: volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 is already attached to instances: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:15:58 user devstack@n-api.service[72773]: request: POST /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments HTTP/1.1 Apr 14 00:15:58 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:15:58 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:15:58 user devstack@n-api.service[72773]: Connection: close Apr 14 00:15:58 user devstack@n-api.service[72773]: Content-Length: 74 Apr 14 00:15:58 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:15:58 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:15:58 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:15:58 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:15:58 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:15:58 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:15:58 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:15:58 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:15:58 user devstack@n-api.service[72773]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:15:58 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:15:58 user devstack@n-api.service[72773]: Apr 14 00:15:58 user devstack@n-api.service[72773]: {"volumeAttachment": {"volumeId": "ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1"}} Apr 14 00:15:58 user devstack@n-api.service[72773]: method: > Apr 14 00:15:58 user devstack@n-api.service[72773]: exception: Invalid volume: volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 is already attached to instances: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 Apr 14 00:15:58 user devstack@n-api.service[72773]: action_args: {'server_id': 'e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8', 'body': {'volumeAttachment': {'volumeId': 'ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1'}}} Apr 14 00:15:58 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 is already attached to instances: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 is already attached to instances: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 is already attached to instances: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 Apr 14 00:15:58 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 400 to user: Invalid volume: volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 is already attached to instances: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:15:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4439c890-ae08-4f82-b9f8-e668e09f9887 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111800 Apr 14 00:15:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 266/576] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:15:58 2023] POST /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:58 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'services' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:15:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments/ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1" status: 202 len: 0 microversion: 2.1 time: 0.174155 Apr 14 00:15:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 279/577] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:15:58 2023] DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments/ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:15:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:15:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f4c2056a-d425-429e-838a-af9894a2da33 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050148 Apr 14 00:15:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 267/578] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:15:58 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] HTTP exception thrown: Instance 13860c45-6a4b-48ea-9d0f-d50656585637 could not be found. Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Request method failure captured: Apr 14 00:16:00 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637 HTTP/1.1 Apr 14 00:16:00 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:16:00 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:16:00 user devstack@n-api.service[72774]: Connection: close Apr 14 00:16:00 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:16:00 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:16:00 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:16:00 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:16:00 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJqa0Ngcdw9rPySNGvAcs_QnlWOmAjH3Pjn40ESyy-tazx8xbvNnqUWieW91xD7GyVHXwo7k0rTJqtkYnzUyAXjKeoeDvR-tRi4wj7_r5ANWMoAJXzWhzKfGLFg0rsAS6Y_ea8T_yXKs34Iz0vYH8BdFernj3W3cvAENeEOv__D7-NE Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Project-Id: 67e9bf71f0644907979ec775c62a0b39 Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesActionsTest-422643142 Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/67e9bf71f0644907979ec775c62a0b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67e9bf71f0644907979ec775c62a0b39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67e9bf71f0644907979ec775c62a0b39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesActionsTest-422643142 Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Tenant-Id: 67e9bf71f0644907979ec775c62a0b39 Apr 14 00:16:00 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesActionsTest-422643142 Apr 14 00:16:00 user devstack@n-api.service[72774]: X-User: tempest-VolumesActionsTest-422643142-project-member Apr 14 00:16:00 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:16:00 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:16:00 user devstack@n-api.service[72774]: X-User-Id: 719f2342cc1d452daae3a4ded790f69a Apr 14 00:16:00 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesActionsTest-422643142-project-member Apr 14 00:16:00 user devstack@n-api.service[72774]: method: > Apr 14 00:16:00 user devstack@n-api.service[72774]: exception: Instance 13860c45-6a4b-48ea-9d0f-d50656585637 could not be found. Apr 14 00:16:00 user devstack@n-api.service[72774]: action_args: {'id': '13860c45-6a4b-48ea-9d0f-d50656585637'} Apr 14 00:16:00 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13860c45-6a4b-48ea-9d0f-d50656585637 could not be found. Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13860c45-6a4b-48ea-9d0f-d50656585637 could not be found. Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13860c45-6a4b-48ea-9d0f-d50656585637 could not be found. Apr 14 00:16:00 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:16:00 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Returning 404 to user: Instance 13860c45-6a4b-48ea-9d0f-d50656585637 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:16:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-77b78d6b-ab16-49eb-9b6d-f9f7be30e6e2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637" status: 404 len: 111 microversion: 2.1 time: 0.033359 Apr 14 00:16:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 280/579] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:00 2023] GET /compute/v2.1/servers/13860c45-6a4b-48ea-9d0f-d50656585637 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:16:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-642127814", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "e3acf139-a0c8-4b33-aae5-26131d3dccb5"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:00 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] validate_networks() for [('e3acf139-a0c8-4b33-aae5-26131d3dccb5', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Getting quotas for project 67e9bf71f0644907979ec775c62a0b39. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Getting quotas for user 719f2342cc1d452daae3a4ded790f69a and project 67e9bf71f0644907979ec775c62a0b39. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:16:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:16:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.704939 Apr 14 00:16:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 268/580] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:16:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:16:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-151b2528-b22f-4d28-83dd-3a6543ac32f1 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:01 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-151b2528-b22f-4d28-83dd-3a6543ac32f1 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:01 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-151b2528-b22f-4d28-83dd-3a6543ac32f1 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-151b2528-b22f-4d28-83dd-3a6543ac32f1 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5" status: 200 len: 1207 microversion: 2.1 time: 0.069297 Apr 14 00:16:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 281/581] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:01 2023] GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5 => generated 1207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:04 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f97792-efc1-4976-bde1-70d7f9047cb5", "tag": "91cab0f7-d11a-451f-8708-b1d2917834cc"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Creating event network-changed:91cab0f7-d11a-451f-8708-b1d2917834cc for instance 02f97792-efc1-4976-bde1-70d7f9047cb5 on user Apr 14 00:16:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032920 Apr 14 00:16:04 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 269/582] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:04 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:04 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:16:04 user devstack@n-api.service[72774]: DEBUG nova.compute.api [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:16:04 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 Apr 14 00:16:04 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 282/583] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:06 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f97792-efc1-4976-bde1-70d7f9047cb5", "name": "network-vif-plugged", "status": "completed", "tag": "91cab0f7-d11a-451f-8708-b1d2917834cc"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Creating event network-vif-plugged:91cab0f7-d11a-451f-8708-b1d2917834cc for instance 02f97792-efc1-4976-bde1-70d7f9047cb5 on user Apr 14 00:16:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175768 Apr 14 00:16:06 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 270/584] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:16:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Apr 14 00:16:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 283/585] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9693166b-92aa-49ac-8a18-6a7a4ad4e119"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d45968c3-f577-4623-802b-0c882d10b4ce tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.586283 Apr 14 00:16:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 271/586] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 00:16:06 2023] POST /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-volume_attachments => generated 188 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1557759785"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:07 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-91a55e35-4696-475d-8b97-cadbbd45d2d4 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-volume_attachments/9693166b-92aa-49ac-8a18-6a7a4ad4e119" status: 202 len: 0 microversion: 2.20 time: 0.264027 Apr 14 00:16:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 272/587] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 00:16:07 2023] DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-volume_attachments/9693166b-92aa-49ac-8a18-6a7a4ad4e119 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72773) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 00:16:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/action" status: 202 len: 0 microversion: 2.20 time: 0.142693 Apr 14 00:16:08 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 273/588] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:16:08 2023] POST /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a6cbc13e-3f31-4ef9-b738-072d4cf1463a tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1657 microversion: 2.20 time: 0.193513 Apr 14 00:16:08 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 274/589] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:16:08 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1657 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f97792-efc1-4976-bde1-70d7f9047cb5", "name": "network-vif-plugged", "status": "completed", "tag": "91cab0f7-d11a-451f-8708-b1d2917834cc"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:08 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Creating event network-vif-plugged:91cab0f7-d11a-451f-8708-b1d2917834cc for instance 02f97792-efc1-4976-bde1-70d7f9047cb5 on user Apr 14 00:16:08 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058809 Apr 14 00:16:08 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 275/590] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb/action" status: 202 len: 52 microversion: 2.87 time: 1.333683 Apr 14 00:16:08 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 284/591] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:16:07 2023] POST /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb/action => generated 52 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 00:16:11 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:11 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Creating event network-changed:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:16:11 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096072 Apr 14 00:16:11 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 276/592] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:13 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-67604c72-3b3c-4607-8890-9e07a2ab5715 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 200 len: 1537 microversion: 2.1 time: 0.286495 Apr 14 00:16:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 285/593] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:13 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:15 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-621f10ef-41db-466a-9f45-a2f191f80cee tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb" status: 200 len: 1692 microversion: 2.87 time: 0.249457 Apr 14 00:16:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 277/594] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:16:15 2023] GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:16:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-plugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Creating event network-vif-plugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:16:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073008 Apr 14 00:16:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 286/595] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] HTTP exception thrown: Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 could not be found. Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Request method failure captured: Apr 14 00:16:18 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7 HTTP/1.1 Apr 14 00:16:18 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:16:18 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:16:18 user devstack@n-api.service[72773]: Connection: close Apr 14 00:16:18 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:16:18 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:16:18 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:16:18 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:16:18 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJquvFYq3hT8mrEZva47qjESubiPUgHRXGlyB1_N-cpQkL3eIFEop3LsS6cPy0kyCXUiva6SUNe5PpvlCMMgYiD2emINw7K9MqO0q0V1R5g9fy-KSOe9PjgG4Jio68WEwakV_vn0QagVWsViJVYusJrmRshqXO-VPn9WGIqKZpey6fc Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Project-Id: 3d9d27c26e8e4b529040d8909aec1a04 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesNegativeTest-1085100121 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d9d27c26e8e4b529040d8909aec1a04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d9d27c26e8e4b529040d8909aec1a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d9d27c26e8e4b529040d8909aec1a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesNegativeTest-1085100121 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Tenant-Id: 3d9d27c26e8e4b529040d8909aec1a04 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesNegativeTest-1085100121 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-User: tempest-VolumesNegativeTest-1085100121-project-member Apr 14 00:16:18 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:16:18 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:16:18 user devstack@n-api.service[72773]: X-User-Id: bb07ce4305014dfaacd6283e4fcab068 Apr 14 00:16:18 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesNegativeTest-1085100121-project-member Apr 14 00:16:18 user devstack@n-api.service[72773]: method: > Apr 14 00:16:18 user devstack@n-api.service[72773]: exception: Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 could not be found. Apr 14 00:16:18 user devstack@n-api.service[72773]: action_args: {'id': '7553ffb8-704b-4b9c-8a15-13357f4ac9e7'} Apr 14 00:16:18 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 could not be found. Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 could not be found. Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 could not be found. Apr 14 00:16:18 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Returning 404 to user: Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:16:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-39a026b9-4c6c-4034-b251-3e304b10422f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7" status: 404 len: 111 microversion: 2.1 time: 0.062129 Apr 14 00:16:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 278/596] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:18 2023] GET /compute/v2.1/servers/7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:16:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-plugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Creating event network-vif-plugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:16:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036761 Apr 14 00:16:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 287/597] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a000737d-73b0-475f-889c-00ea3ff4267e"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=11 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 while it is in vm_state rescued Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Request method failure captured: Apr 14 00:16:32 user devstack@n-api.service[72773]: request: POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/os-volume_attachments HTTP/1.1 Apr 14 00:16:32 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:16:32 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:16:32 user devstack@n-api.service[72773]: Connection: close Apr 14 00:16:32 user devstack@n-api.service[72773]: Content-Length: 74 Apr 14 00:16:32 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:16:32 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:16:32 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:16:32 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJnU9NoR16K4jD4Bh4PI7TXl-Wss5ITDouS9HFhRkZkEP6TA5ATNRb-lCaL6WqWoz32ly5ZoyLfoHcZi1_01Txos1P9o-ypWg3-KePDlInNnXk4z6Me7CNMVmwr0BIQrDnY1C11VQALNxSPTQ_soH50f30qTk_dF25qZIhQIj6TnwmI Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Project-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Tenant-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-User: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:16:32 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:16:32 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:16:32 user devstack@n-api.service[72773]: X-User-Id: f43f3171ccad4167ac783bbdfe2df478 Apr 14 00:16:32 user devstack@n-api.service[72773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:16:32 user devstack@n-api.service[72773]: Apr 14 00:16:32 user devstack@n-api.service[72773]: {"volumeAttachment": {"volumeId": "a000737d-73b0-475f-889c-00ea3ff4267e"}} Apr 14 00:16:32 user devstack@n-api.service[72773]: method: > Apr 14 00:16:32 user devstack@n-api.service[72773]: exception: Cannot 'attach_volume' instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 while it is in vm_state rescued Apr 14 00:16:32 user devstack@n-api.service[72773]: action_args: {'server_id': '6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9', 'body': {'volumeAttachment': {'volumeId': 'a000737d-73b0-475f-889c-00ea3ff4267e'}}} Apr 14 00:16:32 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 while it is in vm_state rescued Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 while it is in vm_state rescued Apr 14 00:16:32 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:16:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Returning 409 to user: Cannot 'attach_volume' instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 while it is in vm_state rescued {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:16:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-730fbf17-93b8-4c03-bbfe-257f9c57b9d2 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077049 Apr 14 00:16:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 279/598] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:16:32 2023] POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/os-volume_attachments => generated 152 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/action" status: 202 len: 0 microversion: 2.1 time: 0.148350 Apr 14 00:16:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 288/599] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:16:32 2023] POST /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:33 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:33 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-988789bb-0626-4be5-b741-a4ac064450b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1498 microversion: 2.1 time: 0.379076 Apr 14 00:16:33 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 280/600] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:33 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-unplugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Creating event network-vif-unplugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:16:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089994 Apr 14 00:16:34 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 289/601] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}, {"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:16:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:16:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047610 Apr 14 00:16:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 281/602] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:16:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041515 Apr 14 00:16:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 290/603] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:39 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b018e916-1359-4ba9-9227-1772c5904b95 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1723 microversion: 2.1 time: 0.219709 Apr 14 00:16:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 282/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:39 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9b055be1-b14d-4bf2-b759-1d54015abb3d tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Action: 'create', calling method: .version_select at 0x7f3db6919480>, body: {"keypair": {"name": "tempest-TestShelveInstance-266505447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+PTdQ169W4Ik0XJKAX1vms0H6bKP2Yz2If5eK4IKeWDFl4zKDtIms+QmK6CN9t818K0haZCxWGM5VZYA/HUy2ewr54rCodMDtSTJaDzyD+lhV417bVgrES1KaG3eBq0w=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:45 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-9b055be1-b14d-4bf2-b759-1d54015abb3d tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting quotas for project e6be95e5c8d94269802ecf487ff73104. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:16:45 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-9b055be1-b14d-4bf2-b759-1d54015abb3d tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting quotas for user b81e5ce5d2414980a506d0f3b37d0d5c and project e6be95e5c8d94269802ecf487ff73104. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:16:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9b055be1-b14d-4bf2-b759-1d54015abb3d tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.304149 Apr 14 00:16:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 291/605] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:16:45 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:48 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-641bf678-400b-4958-8078-bb3cd3497bee tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066152 Apr 14 00:16:48 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 283/606] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:16:48 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:48 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:16:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 204 len: 0 microversion: 2.1 time: 0.129948 Apr 14 00:16:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 292/607] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:16:48 2023] DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f3736251-b852-4583-89ea-6479e1a58347 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 200 len: 1670 microversion: 2.1 time: 0.251922 Apr 14 00:16:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 284/608] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:49 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "name": "network-vif-unplugged", "status": "completed", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Creating event network-vif-unplugged:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:16:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035795 Apr 14 00:16:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 293/609] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "name": "network-vif-deleted", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] Creating event network-vif-deleted:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:16:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030024 Apr 14 00:16:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 285/610] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-454867915", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-266505447", "security_groups": [{"name": "tempest-secgroup-smoke-1257747589"}], "networks": [{"uuid": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc"}], "block_device_mapping_v2": [{"uuid": "69599ada-93d4-425a-ae12-e52cafcc29f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8", "name": "network-vif-plugged", "status": "completed", "tag": "adb392b2-602f-421d-b26b-1e8f243cacff"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Creating event network-vif-plugged:adb392b2-602f-421d-b26b-1e8f243cacff for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 on user Apr 14 00:16:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070741 Apr 14 00:16:51 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 286/611] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:51 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] validate_networks() for [('9f0b7c66-0d95-4c5f-8c77-6f12228c20fc', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:16:52 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f2c7ac20-1009-43e2-9bac-3e8bb520a31e tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5" status: 200 len: 1486 microversion: 2.1 time: 0.289602 Apr 14 00:16:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 287/612] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:51 2023] GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5 => generated 1486 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting quotas for project e6be95e5c8d94269802ecf487ff73104. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting quotas for user b81e5ce5d2414980a506d0f3b37d0d5c and project e6be95e5c8d94269802ecf487ff73104. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:16:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69599ada-93d4-425a-ae12-e52cafcc29f7',volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:16:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.407969 Apr 14 00:16:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 294/613] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:16:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 00:16:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-269a7318-272e-4825-bd48-2bc33a958e86 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-269a7318-272e-4825-bd48-2bc33a958e86 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:52 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-269a7318-272e-4825-bd48-2bc33a958e86 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-269a7318-272e-4825-bd48-2bc33a958e86 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1082 microversion: 2.1 time: 0.078233 Apr 14 00:16:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 288/614] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:16:52 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1082 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:16:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:16:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Creating event network-changed:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:16:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038054 Apr 14 00:16:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 295/615] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:16:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:58 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:16:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-718507f6-c22d-4682-b0e9-4eec3289b003 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1702 microversion: 2.20 time: 0.186159 Apr 14 00:16:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 289/616] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:16:58 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1702 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:17:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-plugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Creating event network-vif-plugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:17:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063153 Apr 14 00:17:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 296/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-plugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=26 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:03 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=47 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Creating event network-vif-plugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:17:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064803 Apr 14 00:17:03 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 290/618] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=10 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-219bc2fd-e1bc-47e3-af6d-59856a15e6ea tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.113980 Apr 14 00:17:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 297/619] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:17:13 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-interface => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:14 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:14 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:14 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Creating event network-changed:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:17:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035501 Apr 14 00:17:14 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 291/620] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:14 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:14 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a02ee29a-45a2-459e-9fa1-b6d4a7be88b3 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/ips" status: 200 len: 103 microversion: 2.1 time: 0.044585 Apr 14 00:17:14 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 298/621] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:17:14 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/ips => generated 103 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1831378742", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "6db62068-7278-4cd8-b41f-d0140d89e199", "destination_type": "volume"}], "networks": [{"uuid": "491696ea-38ef-4c19-9d94-a61223c1fa00"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] validate_networks() for [('491696ea-38ef-4c19-9d94-a61223c1fa00', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:15 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:17:16 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting quotas for user 90bad96535c3453792982c5acab9dbc6 and project ba3f111e24414976beddba7ef90c4793. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:17:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:17:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:17:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.554698 Apr 14 00:17:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 292/622] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 00:17:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 00:17:16 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-30863281-127e-4b0d-8b68-cd0f0252a32c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:16 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-30863281-127e-4b0d-8b68-cd0f0252a32c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:16 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-30863281-127e-4b0d-8b68-cd0f0252a32c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:16 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-30863281-127e-4b0d-8b68-cd0f0252a32c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:16 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-30863281-127e-4b0d-8b68-cd0f0252a32c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-30863281-127e-4b0d-8b68-cd0f0252a32c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1395 microversion: 2.87 time: 0.092266 Apr 14 00:17:16 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 299/623] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:17:16 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89a24f9a-783f-4d14-8413-4fb61263665e"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:17 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:17 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408079 Apr 14 00:17:17 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 293/624] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:17:17 2023] POST /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Creating event network-changed:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:17:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029792 Apr 14 00:17:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 300/625] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:23 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-5bc3340e-3d90-4546-871b-3a01031de405 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1504 microversion: 2.1 time: 0.149243 Apr 14 00:17:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 294/626] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:23 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:25 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-44a9eff3-32d5-4d92-9d85-99603790b6a2 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051996 Apr 14 00:17:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 301/627] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:17:25 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6896efb1-5095-4392-8988-243a931b69a8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/89a24f9a-783f-4d14-8413-4fb61263665e" status: 200 len: 194 microversion: 2.1 time: 0.046783 Apr 14 00:17:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 295/628] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 00:17:25 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/89a24f9a-783f-4d14-8413-4fb61263665e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7501233-eeb6-4ef4-8e07-4f0b28e2f902"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296764 Apr 14 00:17:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 302/629] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:17:27 2023] POST /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:17:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044527 Apr 14 00:17:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 296/630] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:17:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054546 Apr 14 00:17:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 303/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-7d0218c1-d69d-4d93-9493-267273a56d82 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.330891 Apr 14 00:17:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 297/632] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:17:35 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments => generated 371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-863bc3d1-1303-48bd-ac81-64ac5eec322e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/89a24f9a-783f-4d14-8413-4fb61263665e" status: 200 len: 194 microversion: 2.1 time: 0.045956 Apr 14 00:17:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 304/633] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 00:17:36 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/89a24f9a-783f-4d14-8413-4fb61263665e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:36 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'services' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:17:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/89a24f9a-783f-4d14-8413-4fb61263665e" status: 202 len: 0 microversion: 2.1 time: 0.179591 Apr 14 00:17:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 298/634] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:17:36 2023] DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/89a24f9a-783f-4d14-8413-4fb61263665e => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-68fb6c58-34f4-41c9-8bc2-34e4179a229d tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/a7501233-eeb6-4ef4-8e07-4f0b28e2f902" status: 200 len: 194 microversion: 2.1 time: 0.041591 Apr 14 00:17:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 305/635] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 00:17:38 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/a7501233-eeb6-4ef4-8e07-4f0b28e2f902 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:38 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'services' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:17:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/a7501233-eeb6-4ef4-8e07-4f0b28e2f902" status: 202 len: 0 microversion: 2.1 time: 0.161650 Apr 14 00:17:38 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 299/636] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:17:38 2023] DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments/a7501233-eeb6-4ef4-8e07-4f0b28e2f902 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:17:39 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 HTTP/1.1 Apr 14 00:17:39 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:17:39 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:17:39 user devstack@n-api.service[72774]: Connection: close Apr 14 00:17:39 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:17:39 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:17:39 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:17:39 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:17:39 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:17:39 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:17:39 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:17:39 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:17:39 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:17:39 user devstack@n-api.service[72774]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:17:39 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:17:39 user devstack@n-api.service[72774]: method: > Apr 14 00:17:39 user devstack@n-api.service[72774]: exception: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:17:39 user devstack@n-api.service[72774]: action_args: {'id': 'e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8'} Apr 14 00:17:39 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:17:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:17:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-036f3e9e-cee0-46e0-bda2-aded74330f29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 404 len: 111 microversion: 2.1 time: 0.028460 Apr 14 00:17:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 306/637] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:39 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-88f9152a-7854-4130-aab4-39d691a6495a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '.version_select at 0x7f3db67a5000>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-88f9152a-7854-4130-aab4-39d691a6495a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854176898" status: 202 len: 0 microversion: 2.1 time: 0.028755 Apr 14 00:17:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 300/638] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:17:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854176898 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:39 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7c97570f-27f9-42b6-bbb0-3bd6ef387988 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1723 microversion: 2.1 time: 0.174608 Apr 14 00:17:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 307/639] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:39 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:40 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bfd64384-f2ab-4a98-b0f6-77d6a6c4b6c9 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1723 microversion: 2.1 time: 0.225552 Apr 14 00:17:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 301/640] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:39 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0b42fea3-5dcd-4307-9240-5471e408a976 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: .version_select at 0x7f3db6b66b00>, body: {"keypair": {"name": "tempest-keypair-1861608591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPr0jyTwvDHPJLpGUrzkkGrxlDbGIF7ZL08n94HAoGHssCr+iA4uVoJBoD+5iWgWcLutO8dmofk8s0wiKfrqS9Pq9CO1MVlpiKLplRNt4H2+cAhTa75oMeQEi6CQ3pbgw=="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:40 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-0b42fea3-5dcd-4307-9240-5471e408a976 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:17:40 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-0b42fea3-5dcd-4307-9240-5471e408a976 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'key_pairs'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:17:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0b42fea3-5dcd-4307-9240-5471e408a976 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045068 Apr 14 00:17:40 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 308/641] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:17:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9f2240ca-dcc7-4419-bf31-8d7d965eb600 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054190 Apr 14 00:17:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 302/642] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:17:41 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1519ad22-b4cc-4e20-9095-7c306deae5b5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045205 Apr 14 00:17:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 309/643] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:17:41 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:17:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 204 len: 0 microversion: 2.1 time: 0.152075 Apr 14 00:17:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 303/644] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:17:41 2023] DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "name": "network-vif-unplugged", "status": "completed", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Creating event network-vif-unplugged:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:17:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-147f5c6b-f034-4acb-92ae-56a46ec258d0 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 200 len: 1662 microversion: 2.1 time: 0.272618 Apr 14 00:17:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 310/645] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:41 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 1662 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043004 Apr 14 00:17:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 304/646] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2010253673", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6d80f923-8aef-45df-921b-f77ed4ff0e75"}], "security_groups": [{"name": "tempest-securitygroup--1102533861"}], "key_name": "tempest-keypair-1861608591", "user_data": "}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] validate_networks() for [('6d80f923-8aef-45df-921b-f77ed4ff0e75', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting quotas for user fb293fdfc658466aaa7134269fa46a7c and project 44c9d67ad2fa4cb9ab309b98f8fe051a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:17:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.593911 Apr 14 00:17:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 311/647] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:17:41 2023] POST /compute/v2.1/servers => generated 400 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:17:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d7a9dc1c-29ea-40b8-8fa8-f06bbcac8093 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:42 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d7a9dc1c-29ea-40b8-8fa8-f06bbcac8093 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:42 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-d7a9dc1c-29ea-40b8-8fa8-f06bbcac8093 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d7a9dc1c-29ea-40b8-8fa8-f06bbcac8093 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 200 len: 1236 microversion: 2.1 time: 0.095151 Apr 14 00:17:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 305/648] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:42 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1399940b-a6b6-4b17-85e5-9281912b27ab tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1431 microversion: 2.1 time: 0.424010 Apr 14 00:17:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 312/649] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:42 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1431 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "name": "network-vif-deleted", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] Creating event network-vif-deleted:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:17:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Apr 14 00:17:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 306/650] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfe388b-396b-4ce9-97aa-9049cbcb32f4", "name": "network-vif-plugged", "status": "completed", "tag": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:43 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Creating event network-vif-plugged:7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 on user Apr 14 00:17:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038733 Apr 14 00:17:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 313/651] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:45 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:45 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Creating event network-changed:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:17:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041975 Apr 14 00:17:45 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 307/652] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "name": "network-vif-plugged", "status": "completed", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Creating event network-vif-plugged:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:17:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048788 Apr 14 00:17:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 314/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "name": "network-vif-plugged", "status": "completed", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Creating event network-vif-plugged:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:17:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031419 Apr 14 00:17:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 308/654] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=10 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:17:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5" status: 204 len: 0 microversion: 2.1 time: 0.197947 Apr 14 00:17:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 315/655] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:17:52 2023] DELETE /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:53 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-dbeebfe1-2e98-4dd8-a556-e11ced4c2fc8 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5" status: 200 len: 1492 microversion: 2.1 time: 0.198376 Apr 14 00:17:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 309/656] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:17:52 2023] GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5 => generated 1492 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f97792-efc1-4976-bde1-70d7f9047cb5", "name": "network-vif-unplugged", "status": "completed", "tag": "91cab0f7-d11a-451f-8708-b1d2917834cc"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Creating event network-vif-unplugged:91cab0f7-d11a-451f-8708-b1d2917834cc for instance 02f97792-efc1-4976-bde1-70d7f9047cb5 on user Apr 14 00:17:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035894 Apr 14 00:17:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 316/657] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f97792-efc1-4976-bde1-70d7f9047cb5", "name": "network-vif-deleted", "tag": "91cab0f7-d11a-451f-8708-b1d2917834cc"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] Creating event network-vif-deleted:91cab0f7-d11a-451f-8708-b1d2917834cc for instance 02f97792-efc1-4976-bde1-70d7f9047cb5 on user Apr 14 00:17:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Apr 14 00:17:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 310/658] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f97792-efc1-4976-bde1-70d7f9047cb5", "name": "network-vif-plugged", "status": "completed", "tag": "91cab0f7-d11a-451f-8708-b1d2917834cc"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Creating event network-vif-plugged:91cab0f7-d11a-451f-8708-b1d2917834cc for instance 02f97792-efc1-4976-bde1-70d7f9047cb5 on user Apr 14 00:17:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034407 Apr 14 00:17:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 317/659] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:58 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-069aaef1-e309-40e7-8032-6fb7c5e26311 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049397 Apr 14 00:17:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 311/660] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 00:17:58 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:17:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 204 len: 0 microversion: 2.20 time: 0.127805 Apr 14 00:17:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 318/661] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:17:58 2023] DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:59 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:17:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-abdf24c6-8c11-43e6-9c90-080093b6f3e3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 200 len: 1708 microversion: 2.20 time: 0.330714 Apr 14 00:17:59 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 312/662] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:17:59 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 1708 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-unplugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:17:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:17:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Creating event network-vif-unplugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:17:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032089 Apr 14 00:17:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 319/663] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:17:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-plugged", "status": "completed", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}, {"server_uuid": "6c35b78e-41e3-40c1-b265-8e1fa5e859c6", "name": "network-vif-deleted", "tag": "62d9fce8-6815-4a29-ab53-d1205a2db648"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Creating event network-vif-plugged:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:18:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Creating event network-vif-deleted:62d9fce8-6815-4a29-ab53-d1205a2db648 for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 on user Apr 14 00:18:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034817 Apr 14 00:18:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 313/664] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:06 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0e06c176-b1c9-498b-b6c1-2bcf09bf0a2b tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1769 microversion: 2.87 time: 0.174105 Apr 14 00:18:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 320/665] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:18:06 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1769 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:18:26 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=13 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:26 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=25 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:26 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c46757a6-cb62-4ccc-9ed3-994deaa7b909 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'create', calling method: .version_select at 0x7f3db6838ee0>, body: {"keypair": {"name": "tempest-keypair-2020248029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPJl6SDPfCFQp4baCPxy+GI6LhLuQU3NPsG3291XLwXmLvJxDSbMZPnAUG2FnoP7gWRMoPh0RxuN0i+Igwez3QU2DJmViyuFIRLYjK8+Jg8nIMy2dRZs6Aqrth2wJ7mNQ=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:26 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-c46757a6-cb62-4ccc-9ed3-994deaa7b909 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:18:26 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-c46757a6-cb62-4ccc-9ed3-994deaa7b909 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for user f43f3171ccad4167ac783bbdfe2df478 and project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:18:26 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c46757a6-cb62-4ccc-9ed3-994deaa7b909 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061927 Apr 14 00:18:26 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 314/666] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:18:26 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-576521395", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "08106daa-a35e-4376-8c46-2b4baa51c6ea"}], "security_groups": [{"name": "tempest-securitygroup--1298007026"}], "key_name": "tempest-keypair-2020248029", "user_data": "}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:27 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:27 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:27 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] validate_networks() for [('08106daa-a35e-4376-8c46-2b4baa51c6ea', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting quotas for user f43f3171ccad4167ac783bbdfe2df478 and project 524265958bd24a6cb94aa3115eb2b6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:18:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:18:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.572407 Apr 14 00:18:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 321/667] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:18:27 2023] POST /compute/v2.1/servers => generated 407 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:18:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ed57f9ae-4045-45d9-8719-f94dbf4f810b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ed57f9ae-4045-45d9-8719-f94dbf4f810b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ed57f9ae-4045-45d9-8719-f94dbf4f810b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ed57f9ae-4045-45d9-8719-f94dbf4f810b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1239 microversion: 2.1 time: 0.062514 Apr 14 00:18:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 315/668] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:28 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Creating event network-changed:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:18:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036054 Apr 14 00:18:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 322/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HTTP exception thrown: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Request method failure captured: Apr 14 00:18:31 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 HTTP/1.1 Apr 14 00:18:31 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:18:31 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:18:31 user devstack@n-api.service[72773]: Connection: close Apr 14 00:18:31 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:18:31 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:18:31 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:18:31 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:18:31 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiiCW40gNsPTEFpiH3tK2APNFm2AIrjR32585IITKD-JgH-2ACUHwcBEyasPnw5FFAA__ChIbvWU4mGRgnt7ZwMMKcl6j7lrz9vO3m8APuHZTVt1EX5g97E8kB2cSOJFb03o69rO_YNHX7dHXjuXjLJwO5HQQizFPuwmcguuONtmIg Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Project-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Tenant-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:31 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:31 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:31 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:18:31 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:18:31 user devstack@n-api.service[72773]: X-User-Id: 44530987616b417d87ce5909d8de1871 Apr 14 00:18:31 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:31 user devstack@n-api.service[72773]: method: > Apr 14 00:18:31 user devstack@n-api.service[72773]: exception: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:31 user devstack@n-api.service[72773]: action_args: {'id': '1cfe388b-396b-4ce9-97aa-9049cbcb32f4'} Apr 14 00:18:31 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Returning 404 to user: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b77577e8-b88e-49bb-a373-9a73380e803b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 404 len: 111 microversion: 2.1 time: 0.058141 Apr 14 00:18:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 316/670] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:31 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:18:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-43c4519b-2168-43b2-b9ac-f3a1696ed03b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '.version_select at 0x7f3db6918700>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-43c4519b-2168-43b2-b9ac-f3a1696ed03b tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596000720" status: 202 len: 0 microversion: 2.1 time: 0.041995 Apr 14 00:18:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 323/671] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:18:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596000720 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:33 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:33 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a24c78a6-db0c-4430-9e81-e9bed544b225 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 200 len: 1545 microversion: 2.1 time: 0.344206 Apr 14 00:18:33 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 317/672] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:32 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 1545 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:18:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069847 Apr 14 00:18:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 324/673] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:18:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Apr 14 00:18:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 318/674] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HTTP exception thrown: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Request method failure captured: Apr 14 00:18:39 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 HTTP/1.1 Apr 14 00:18:39 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:18:39 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:18:39 user devstack@n-api.service[72774]: Connection: close Apr 14 00:18:39 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:18:39 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:18:39 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:18:39 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:18:39 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiiCW40gNsPTEFpiH3tK2APNFm2AIrjR32585IITKD-JgH-2ACUHwcBEyasPnw5FFAA__ChIbvWU4mGRgnt7ZwMMKcl6j7lrz9vO3m8APuHZTVt1EX5g97E8kB2cSOJFb03o69rO_YNHX7dHXjuXjLJwO5HQQizFPuwmcguuONtmIg Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Project-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Tenant-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:39 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:39 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:39 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:18:39 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:18:39 user devstack@n-api.service[72774]: X-User-Id: 44530987616b417d87ce5909d8de1871 Apr 14 00:18:39 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:39 user devstack@n-api.service[72774]: method: > Apr 14 00:18:39 user devstack@n-api.service[72774]: exception: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72774]: action_args: {'id': '1cfe388b-396b-4ce9-97aa-9049cbcb32f4'} Apr 14 00:18:39 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Returning 404 to user: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3d8c6332-b61e-4908-a1c5-c947a866f477 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 404 len: 111 microversion: 2.1 time: 0.040072 Apr 14 00:18:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 325/675] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:18:39 2023] DELETE /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HTTP exception thrown: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Request method failure captured: Apr 14 00:18:39 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 HTTP/1.1 Apr 14 00:18:39 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:18:39 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:18:39 user devstack@n-api.service[72773]: Connection: close Apr 14 00:18:39 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:18:39 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:18:39 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:18:39 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:18:39 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiiCW40gNsPTEFpiH3tK2APNFm2AIrjR32585IITKD-JgH-2ACUHwcBEyasPnw5FFAA__ChIbvWU4mGRgnt7ZwMMKcl6j7lrz9vO3m8APuHZTVt1EX5g97E8kB2cSOJFb03o69rO_YNHX7dHXjuXjLJwO5HQQizFPuwmcguuONtmIg Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Project-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Tenant-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:39 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:39 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:39 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:18:39 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:18:39 user devstack@n-api.service[72773]: X-User-Id: 44530987616b417d87ce5909d8de1871 Apr 14 00:18:39 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:39 user devstack@n-api.service[72773]: method: > Apr 14 00:18:39 user devstack@n-api.service[72773]: exception: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72773]: action_args: {'id': '1cfe388b-396b-4ce9-97aa-9049cbcb32f4'} Apr 14 00:18:39 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. Apr 14 00:18:39 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Returning 404 to user: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9cd50453-c49e-42a3-bba0-b4a540137c11 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4" status: 404 len: 111 microversion: 2.1 time: 0.042861 Apr 14 00:18:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 319/676] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:39 2023] GET /compute/v2.1/servers/1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:18:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 204 len: 0 microversion: 2.1 time: 0.154558 Apr 14 00:18:40 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 326/677] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:18:40 2023] DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-unplugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:40 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-cd858bf8-7b48-4ca3-96c5-37e7598d4a51 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 200 len: 1729 microversion: 2.1 time: 0.316571 Apr 14 00:18:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 320/678] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:40 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Creating event network-vif-unplugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:18:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058573 Apr 14 00:18:40 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 327/679] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-deleted", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] Creating event network-vif-deleted:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:18:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051205 Apr 14 00:18:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 321/680] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3475e7e-ceb4-452a-a045-dbf43c5944dd", "name": "network-vif-plugged", "status": "completed", "tag": "617f05b8-c04e-4abf-b4e5-a0234209624a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Creating event network-vif-plugged:617f05b8-c04e-4abf-b4e5-a0234209624a for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd on user Apr 14 00:18:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041385 Apr 14 00:18:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 328/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HTTP exception thrown: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Request method failure captured: Apr 14 00:18:43 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b HTTP/1.1 Apr 14 00:18:43 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:18:43 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:18:43 user devstack@n-api.service[72773]: Connection: close Apr 14 00:18:43 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:18:43 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:18:43 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:18:43 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:18:43 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiiCW40gNsPTEFpiH3tK2APNFm2AIrjR32585IITKD-JgH-2ACUHwcBEyasPnw5FFAA__ChIbvWU4mGRgnt7ZwMMKcl6j7lrz9vO3m8APuHZTVt1EX5g97E8kB2cSOJFb03o69rO_YNHX7dHXjuXjLJwO5HQQizFPuwmcguuONtmIg Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Tenant-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Id: 44530987616b417d87ce5909d8de1871 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:43 user devstack@n-api.service[72773]: method: > Apr 14 00:18:43 user devstack@n-api.service[72773]: exception: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: action_args: {'id': '01a65362-36ea-4817-8e83-f75d6daf808b'} Apr 14 00:18:43 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Returning 404 to user: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8a38872b-589c-4296-b7bf-22b525e28223 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 404 len: 111 microversion: 2.1 time: 0.029879 Apr 14 00:18:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 322/682] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:18:43 2023] DELETE /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HTTP exception thrown: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Request method failure captured: Apr 14 00:18:43 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b HTTP/1.1 Apr 14 00:18:43 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:18:43 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:18:43 user devstack@n-api.service[72773]: Connection: close Apr 14 00:18:43 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:18:43 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:18:43 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:18:43 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:18:43 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiiCW40gNsPTEFpiH3tK2APNFm2AIrjR32585IITKD-JgH-2ACUHwcBEyasPnw5FFAA__ChIbvWU4mGRgnt7ZwMMKcl6j7lrz9vO3m8APuHZTVt1EX5g97E8kB2cSOJFb03o69rO_YNHX7dHXjuXjLJwO5HQQizFPuwmcguuONtmIg Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec1aab0338ff4bd195a37a4199a378eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Tenant-Id: ec1aab0338ff4bd195a37a4199a378eb Apr 14 00:18:43 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1885059489 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Id: 44530987616b417d87ce5909d8de1871 Apr 14 00:18:43 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeTestJSON-1885059489-project-member Apr 14 00:18:43 user devstack@n-api.service[72773]: method: > Apr 14 00:18:43 user devstack@n-api.service[72773]: exception: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: action_args: {'id': '01a65362-36ea-4817-8e83-f75d6daf808b'} Apr 14 00:18:43 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. Apr 14 00:18:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Returning 404 to user: Instance 01a65362-36ea-4817-8e83-f75d6daf808b could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-26e7941e-c7ae-4915-b195-b5dfad032f37 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b" status: 404 len: 111 microversion: 2.1 time: 0.030597 Apr 14 00:18:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 323/683] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:43 2023] GET /compute/v2.1/servers/01a65362-36ea-4817-8e83-f75d6daf808b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] HTTP exception thrown: Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 could not be found. Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Request method failure captured: Apr 14 00:18:43 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5 HTTP/1.1 Apr 14 00:18:43 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:18:43 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:18:43 user devstack@n-api.service[72774]: Connection: close Apr 14 00:18:43 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:18:43 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:18:43 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:18:43 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:18:43 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJqa0Ngcdw9rPySNGvAcs_QnlWOmAjH3Pjn40ESyy-tazx8xbvNnqUWieW91xD7GyVHXwo7k0rTJqtkYnzUyAXjKeoeDvR-tRi4wj7_r5ANWMoAJXzWhzKfGLFg0rsAS6Y_ea8T_yXKs34Iz0vYH8BdFernj3W3cvAENeEOv__D7-NE Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Project-Id: 67e9bf71f0644907979ec775c62a0b39 Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Project-Name: tempest-VolumesActionsTest-422643142 Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/67e9bf71f0644907979ec775c62a0b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67e9bf71f0644907979ec775c62a0b39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67e9bf71f0644907979ec775c62a0b39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Tenant: tempest-VolumesActionsTest-422643142 Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Tenant-Id: 67e9bf71f0644907979ec775c62a0b39 Apr 14 00:18:43 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-VolumesActionsTest-422643142 Apr 14 00:18:43 user devstack@n-api.service[72774]: X-User: tempest-VolumesActionsTest-422643142-project-member Apr 14 00:18:43 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:18:43 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:18:43 user devstack@n-api.service[72774]: X-User-Id: 719f2342cc1d452daae3a4ded790f69a Apr 14 00:18:43 user devstack@n-api.service[72774]: X-User-Name: tempest-VolumesActionsTest-422643142-project-member Apr 14 00:18:43 user devstack@n-api.service[72774]: method: > Apr 14 00:18:43 user devstack@n-api.service[72774]: exception: Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 could not be found. Apr 14 00:18:43 user devstack@n-api.service[72774]: action_args: {'id': '02f97792-efc1-4976-bde1-70d7f9047cb5'} Apr 14 00:18:43 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 could not be found. Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 could not be found. Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 could not be found. Apr 14 00:18:43 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Returning 404 to user: Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-23353cc7-890a-4223-9836-e473b7a8cbad tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5" status: 404 len: 111 microversion: 2.1 time: 0.191891 Apr 14 00:18:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 329/684] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:43 2023] GET /compute/v2.1/servers/02f97792-efc1-4976-bde1-70d7f9047cb5 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:43 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-53764832-d218-40cd-96fd-c6d88f0fc9b5 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1431 microversion: 2.1 time: 0.205794 Apr 14 00:18:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 324/685] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:43 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1431 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Creating event network-changed:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:18:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037308 Apr 14 00:18:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 330/686] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:45 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'flavor' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:18:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/action" status: 202 len: 0 microversion: 2.1 time: 0.128353 Apr 14 00:18:45 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 325/687] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:18:45 2023] POST /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:46 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:18:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7c32ad8f-67d6-4ac4-9682-e00e6f2377a3 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1437 microversion: 2.1 time: 0.305810 Apr 14 00:18:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 331/688] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:18:45 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1437 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-unplugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}, {"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-plugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Creating event network-vif-unplugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:18:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Creating event network-vif-plugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:18:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033774 Apr 14 00:18:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 326/689] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HTTP exception thrown: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Request method failure captured: Apr 14 00:18:49 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 HTTP/1.1 Apr 14 00:18:49 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:18:49 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:18:49 user devstack@n-api.service[72774]: Connection: close Apr 14 00:18:49 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:18:49 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:18:49 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:18:49 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:18:49 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJihF036sdyF-5p0q2jmgiP2QHAhR_3g2LsFN9AhQnXY0Sj7HhV2ioG40LfatRJk1Lg45saDsHPRtkGgU1tQonJiCZ6ikfwfsXpY0I1mNMTBciZZ1nj8zMtoiY19f9kPki4Ku8zrfXG2hYhYT3l23uuEkYR2eE788jMsNfEsTGbKQzs Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Project-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Tenant-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:49 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:49 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:49 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:18:49 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:18:49 user devstack@n-api.service[72774]: X-User-Id: 2f8b18d40ecd4b4e976cf2018af8220c Apr 14 00:18:49 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:49 user devstack@n-api.service[72774]: method: > Apr 14 00:18:49 user devstack@n-api.service[72774]: exception: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:49 user devstack@n-api.service[72774]: action_args: {'id': '6c35b78e-41e3-40c1-b265-8e1fa5e859c6'} Apr 14 00:18:49 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Returning 404 to user: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e7c90985-2f2f-4cd4-91d9-b93a15fe0f91 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 404 len: 111 microversion: 2.20 time: 0.030438 Apr 14 00:18:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 332/690] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:18:49 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:18:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c6bedb7a-1d4d-4594-8a35-13e4989f96f3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '.version_select at 0x7f3db67a7490>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c6bedb7a-1d4d-4594-8a35-13e4989f96f3 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749403403" status: 204 len: 0 microversion: 2.20 time: 0.024630 Apr 14 00:18:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 327/691] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 00:18:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749403403 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Creating event network-changed:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:18:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047416 Apr 14 00:18:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 333/692] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:18:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:51 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-286e301f-d58e-41ed-b0a4-8e6930f9ecbe tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db6839c60>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-286e301f-d58e-41ed-b0a4-8e6930f9ecbe tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981" status: 200 len: 351 microversion: 2.1 time: 0.055207 Apr 14 00:18:51 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 328/693] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:18:51 2023] GET /compute/v2.1/os-volumes/5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e418a45f-ef9b-4e76-aba9-f0091e12face tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db6b39090>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e418a45f-ef9b-4e76-aba9-f0091e12face tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8dc456e2-5ce9-441f-8852-e0acc6c327ec" status: 200 len: 351 microversion: 2.1 time: 0.065397 Apr 14 00:18:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 334/694] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:18:53 2023] GET /compute/v2.1/os-volumes/8dc456e2-5ce9-441f-8852-e0acc6c327ec => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HTTP exception thrown: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Request method failure captured: Apr 14 00:18:53 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 HTTP/1.1 Apr 14 00:18:53 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:18:53 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:18:53 user devstack@n-api.service[72773]: Connection: close Apr 14 00:18:53 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:18:53 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:18:53 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:18:53 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:18:53 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJihF036sdyF-5p0q2jmgiP2QHAhR_3g2LsFN9AhQnXY0Sj7HhV2ioG40LfatRJk1Lg45saDsHPRtkGgU1tQonJiCZ6ikfwfsXpY0I1mNMTBciZZ1nj8zMtoiY19f9kPki4Ku8zrfXG2hYhYT3l23uuEkYR2eE788jMsNfEsTGbKQzs Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Project-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Tenant-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:53 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:53 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:53 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:18:53 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:18:53 user devstack@n-api.service[72773]: X-User-Id: 2f8b18d40ecd4b4e976cf2018af8220c Apr 14 00:18:53 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:53 user devstack@n-api.service[72773]: method: > Apr 14 00:18:53 user devstack@n-api.service[72773]: exception: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72773]: action_args: {'id': '6c35b78e-41e3-40c1-b265-8e1fa5e859c6'} Apr 14 00:18:53 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Returning 404 to user: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a1d64775-4d6c-4b3f-95e6-2f0665521519 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 404 len: 111 microversion: 2.20 time: 0.033025 Apr 14 00:18:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 329/695] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:18:53 2023] DELETE /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HTTP exception thrown: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Request method failure captured: Apr 14 00:18:53 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 HTTP/1.1 Apr 14 00:18:53 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:18:53 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:18:53 user devstack@n-api.service[72774]: Connection: close Apr 14 00:18:53 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:18:53 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:18:53 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:18:53 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:18:53 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJihF036sdyF-5p0q2jmgiP2QHAhR_3g2LsFN9AhQnXY0Sj7HhV2ioG40LfatRJk1Lg45saDsHPRtkGgU1tQonJiCZ6ikfwfsXpY0I1mNMTBciZZ1nj8zMtoiY19f9kPki4Ku8zrfXG2hYhYT3l23uuEkYR2eE788jMsNfEsTGbKQzs Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Project-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Tenant-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:53 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:53 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:53 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:18:53 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:18:53 user devstack@n-api.service[72774]: X-User-Id: 2f8b18d40ecd4b4e976cf2018af8220c Apr 14 00:18:53 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:53 user devstack@n-api.service[72774]: method: > Apr 14 00:18:53 user devstack@n-api.service[72774]: exception: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72774]: action_args: {'id': '6c35b78e-41e3-40c1-b265-8e1fa5e859c6'} Apr 14 00:18:53 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. Apr 14 00:18:53 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Returning 404 to user: Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5210519c-377e-4d8a-a6e2-d521b9a655e8 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6" status: 404 len: 111 microversion: 2.20 time: 0.050665 Apr 14 00:18:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 335/696] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:18:53 2023] GET /compute/v2.1/servers/6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-14fedf1a-4913-4f05-8133-e5f533a2da43 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db68393f0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-14fedf1a-4913-4f05-8133-e5f533a2da43 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f39da6ca-c616-4b91-8966-df4107a5c582" status: 200 len: 350 microversion: 2.1 time: 0.055151 Apr 14 00:18:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 330/697] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes/f39da6ca-c616-4b91-8966-df4107a5c582 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a9d5b375-37d0-401a-bae6-1997cd879816 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db6742200>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a9d5b375-37d0-401a-bae6-1997cd879816 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098299 Apr 14 00:18:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 336/698] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c392a568-9f91-4bf9-baf5-d6e7bfa97c32 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db683a050>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c392a568-9f91-4bf9-baf5-d6e7bfa97c32 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104499 Apr 14 00:18:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 331/699] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d31d260c-3320-4df7-bf4a-6c0d6bf05667 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db691b0a0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d31d260c-3320-4df7-bf4a-6c0d6bf05667 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.099199 Apr 14 00:18:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 337/700] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-55b10247-79ae-41e7-939e-4f25e5417d8e tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db67a68c0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-55b10247-79ae-41e7-939e-4f25e5417d8e tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114937 Apr 14 00:18:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 332/701] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0ae7fbd5-b400-4864-8b7f-375e17744f58 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db68b6dd0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0ae7fbd5-b400-4864-8b7f-375e17744f58 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091807 Apr 14 00:18:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 338/702] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c42f4405-1afa-4502-be06-9c48f5fcb431 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db68393f0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c42f4405-1afa-4502-be06-9c48f5fcb431 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.155439 Apr 14 00:18:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 333/703] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4c349017-954e-47c0-90b6-02ee1396d84d tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db6743c70>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4c349017-954e-47c0-90b6-02ee1396d84d tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094825 Apr 14 00:18:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 339/704] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:18:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e58de815-8b50-4cc3-adbd-1761b97b5c33 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] Calling method '.version_select at 0x7f3db6839ab0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e58de815-8b50-4cc3-adbd-1761b97b5c33 tempest-VolumesTestJSON-1300607219 tempest-VolumesTestJSON-1300607219-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095209 Apr 14 00:18:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 334/705] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 00:18:56 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:57 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HTTP exception thrown: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Request method failure captured: Apr 14 00:18:57 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a HTTP/1.1 Apr 14 00:18:57 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:18:57 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:18:57 user devstack@n-api.service[72774]: Connection: close Apr 14 00:18:57 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:18:57 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:18:57 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:18:57 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:18:57 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJihF036sdyF-5p0q2jmgiP2QHAhR_3g2LsFN9AhQnXY0Sj7HhV2ioG40LfatRJk1Lg45saDsHPRtkGgU1tQonJiCZ6ikfwfsXpY0I1mNMTBciZZ1nj8zMtoiY19f9kPki4Ku8zrfXG2hYhYT3l23uuEkYR2eE788jMsNfEsTGbKQzs Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Project-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Tenant-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:57 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:57 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:57 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:18:57 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:18:57 user devstack@n-api.service[72774]: X-User-Id: 2f8b18d40ecd4b4e976cf2018af8220c Apr 14 00:18:57 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:57 user devstack@n-api.service[72774]: method: > Apr 14 00:18:57 user devstack@n-api.service[72774]: exception: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72774]: action_args: {'id': '1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a'} Apr 14 00:18:57 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Returning 404 to user: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:57 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e8850dc0-f088-431f-abcb-b12ae0db0496 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 404 len: 111 microversion: 2.20 time: 0.265530 Apr 14 00:18:57 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 340/706] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:18:57 2023] DELETE /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HTTP exception thrown: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Request method failure captured: Apr 14 00:18:57 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a HTTP/1.1 Apr 14 00:18:57 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:18:57 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:18:57 user devstack@n-api.service[72773]: Connection: close Apr 14 00:18:57 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:18:57 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:18:57 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:18:57 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:18:57 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJihF036sdyF-5p0q2jmgiP2QHAhR_3g2LsFN9AhQnXY0Sj7HhV2ioG40LfatRJk1Lg45saDsHPRtkGgU1tQonJiCZ6ikfwfsXpY0I1mNMTBciZZ1nj8zMtoiY19f9kPki4Ku8zrfXG2hYhYT3l23uuEkYR2eE788jMsNfEsTGbKQzs Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Project-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f20caf676a64b9b97027f3fc9bc724c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Tenant-Id: 4f20caf676a64b9b97027f3fc9bc724c Apr 14 00:18:57 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1395403129 Apr 14 00:18:57 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:57 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:18:57 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:18:57 user devstack@n-api.service[72773]: X-User-Id: 2f8b18d40ecd4b4e976cf2018af8220c Apr 14 00:18:57 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1395403129-project-member Apr 14 00:18:57 user devstack@n-api.service[72773]: method: > Apr 14 00:18:57 user devstack@n-api.service[72773]: exception: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72773]: action_args: {'id': '1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a'} Apr 14 00:18:57 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. Apr 14 00:18:57 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:18:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Returning 404 to user: Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:18:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6928e3b5-1eee-41c9-b8f7-7f07d003312e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" status: 404 len: 111 microversion: 2.20 time: 0.050195 Apr 14 00:18:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 335/707] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:18:57 2023] GET /compute/v2.1/servers/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "981cdd24-b6a7-4af7-ab41-830fdcd0e314"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:06 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'flavor' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:19:07 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332/action" status: 200 len: 29 microversion: 2.87 time: 0.420332 Apr 14 00:19:07 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 341/708] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:19:06 2023] POST /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332/action => generated 29 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:07 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:07 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-55692d42-0b3a-4f8c-930f-8bb04ec88007 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1775 microversion: 2.87 time: 0.326314 Apr 14 00:19:07 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 336/709] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:19:07 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1775 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:19:08 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-unplugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Creating event network-vif-unplugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:19:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044409 Apr 14 00:19:08 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 342/710] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:19:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051501 Apr 14 00:19:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 337/711] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:13 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:13 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:19:13 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029453 Apr 14 00:19:13 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 343/712] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:15 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:15 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:19:15 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043129 Apr 14 00:19:15 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 338/713] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:18 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7bb0f050-8cde-4e8b-ad0e-5ec77e9921c4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1554 microversion: 2.1 time: 0.183791 Apr 14 00:19:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 344/714] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:19:18 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=11 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:19:30 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd HTTP/1.1 Apr 14 00:19:30 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:19:30 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:19:30 user devstack@n-api.service[72773]: Connection: close Apr 14 00:19:30 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:19:30 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:19:30 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:19:30 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:19:30 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:19:30 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:30 user devstack@n-api.service[72773]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:19:30 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:19:30 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:19:30 user devstack@n-api.service[72773]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:19:30 user devstack@n-api.service[72773]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:19:30 user devstack@n-api.service[72773]: method: > Apr 14 00:19:30 user devstack@n-api.service[72773]: exception: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72773]: action_args: {'id': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'} Apr 14 00:19:30 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:19:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2f8b880a-4689-4857-9fd1-0bd2d5ee35e5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 404 len: 111 microversion: 2.1 time: 0.038203 Apr 14 00:19:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 339/715] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:19:30 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=7 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:19:30 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments HTTP/1.1 Apr 14 00:19:30 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:19:30 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:19:30 user devstack@n-api.service[72774]: Connection: close Apr 14 00:19:30 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:19:30 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:19:30 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:19:30 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:19:30 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:19:30 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:30 user devstack@n-api.service[72774]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:19:30 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:19:30 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:19:30 user devstack@n-api.service[72774]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:19:30 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:19:30 user devstack@n-api.service[72774]: method: > Apr 14 00:19:30 user devstack@n-api.service[72774]: exception: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72774]: action_args: {'server_id': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'} Apr 14 00:19:30 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:30 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:19:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:19:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-2b5f0c92-0ee9-49a5-a8f6-7ff504850a09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047278 Apr 14 00:19:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 345/716] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:19:30 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:19:31 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd HTTP/1.1 Apr 14 00:19:31 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:19:31 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:19:31 user devstack@n-api.service[72773]: Connection: close Apr 14 00:19:31 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:19:31 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:19:31 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:19:31 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:19:31 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:19:31 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:19:31 user devstack@n-api.service[72773]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:19:31 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:19:31 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:19:31 user devstack@n-api.service[72773]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:19:31 user devstack@n-api.service[72773]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:19:31 user devstack@n-api.service[72773]: method: > Apr 14 00:19:31 user devstack@n-api.service[72773]: exception: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:31 user devstack@n-api.service[72773]: action_args: {'id': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'} Apr 14 00:19:31 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:19:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:19:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:19:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a667e953-0555-4067-a7e5-81e3217c6715 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 404 len: 111 microversion: 2.1 time: 0.039535 Apr 14 00:19:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 340/717] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:19:30 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1841222453", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e"}], "security_groups": [{"name": "tempest-securitygroup--155365803"}], "key_name": "tempest-keypair-1040271550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] validate_networks() for [('cb8c9bb1-a885-486d-aa6a-de600bc01c2e', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:19:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:19:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.841709 Apr 14 00:19:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 346/718] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:19:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:19:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-903202cc-0cf4-4028-9fd9-b27063efa7a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:32 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-903202cc-0cf4-4028-9fd9-b27063efa7a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:32 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-903202cc-0cf4-4028-9fd9-b27063efa7a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-903202cc-0cf4-4028-9fd9-b27063efa7a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60" status: 200 len: 1233 microversion: 2.1 time: 0.121292 Apr 14 00:19:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 341/719] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:19:32 2023] GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 => generated 1233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-66b800e5-9d96-4345-b671-9aba738e244c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.168952 Apr 14 00:19:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 347/720] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:19:33 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:34 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:34 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Creating event network-changed:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:19:34 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038603 Apr 14 00:19:34 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 342/721] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:34 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c3590522-2597-48b0-875f-4308d4ed8f3c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/ips" status: 200 len: 107 microversion: 2.1 time: 0.039226 Apr 14 00:19:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 348/722] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:19:34 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/ips => generated 107 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Creating event network-changed:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:19:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036740 Apr 14 00:19:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 349/723] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:36 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-18a4e97a-378a-4dd2-871b-2b09276147ee tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1497 microversion: 2.1 time: 0.357108 Apr 14 00:19:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 343/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:19:36 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca83f34-5989-4188-abaa-205a9770d290"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600364 Apr 14 00:19:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 350/725] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:19:37 2023] POST /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "name": "network-vif-plugged", "status": "completed", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Creating event network-vif-plugged:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:19:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036351 Apr 14 00:19:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 344/726] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "name": "network-vif-plugged", "status": "completed", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:19:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Creating event network-vif-plugged:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:19:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Apr 14 00:19:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 351/727] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:46 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'services' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:19:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments/bca83f34-5989-4188-abaa-205a9770d290" status: 202 len: 0 microversion: 2.1 time: 0.391869 Apr 14 00:19:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 345/728] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:19:46 2023] DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments/bca83f34-5989-4188-abaa-205a9770d290 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4e748299-178b-45ce-80ad-ab2a3b394ae1 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055183 Apr 14 00:19:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 352/729] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:19:46 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=16 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:57 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:19:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-46c4082a-b8cf-45be-b9ef-945fee92c832 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1755 microversion: 2.87 time: 0.210310 Apr 14 00:19:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 346/730] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:19:57 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-19193c9c-0123-457f-b785-9866aeab70b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.257258 Apr 14 00:20:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 353/731] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:20:18 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-interface => generated 283 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:19 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:19 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Creating event network-changed:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:20:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051806 Apr 14 00:20:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 347/732] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c953a4d-d77b-4d17-bcad-ea49b45adbb9"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343737 Apr 14 00:20:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 354/733] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:20:19 2023] POST /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:22 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ce487b5b-ef6f-4b33-8ba1-7ab4813e2d11 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60" status: 200 len: 1540 microversion: 2.1 time: 0.422328 Apr 14 00:20:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 348/734] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:20:22 2023] GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 => generated 1540 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:27 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:20:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/action" status: 200 len: 32 microversion: 2.1 time: 0.160797 Apr 14 00:20:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 355/735] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:20:27 2023] POST /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-00ccf837-511c-4e22-95ff-ffd5f8e827f8 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1725 microversion: 2.1 time: 0.274135 Apr 14 00:20:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 349/736] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:20:28 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:20:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-unplugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Creating event network-vif-unplugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:20:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114022 Apr 14 00:20:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 356/737] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:20:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039711 Apr 14 00:20:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 350/738] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}, {"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:20:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:20:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030611 Apr 14 00:20:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 357/739] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8cef40e3-6638-48c7-9460-f83faec9c65c tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055295 Apr 14 00:20:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 351/740] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:20:36 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:20:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 204 len: 0 microversion: 2.1 time: 0.125770 Apr 14 00:20:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 358/741] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:20:36 2023] DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72773) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 00:20:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/action" status: 202 len: 0 microversion: 2.1 time: 0.241932 Apr 14 00:20:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 352/742] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:20:36 2023] POST /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:37 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3a9d0c93-026f-4c25-a4ba-791a6974de29 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 200 len: 1669 microversion: 2.1 time: 0.294826 Apr 14 00:20:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 359/743] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:20:36 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:20:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "name": "network-vif-unplugged", "status": "completed", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Creating event network-vif-unplugged:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:20:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027501 Apr 14 00:20:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 360/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:37 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3798eeca-8de0-454e-9a93-9cd5849253d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1505 microversion: 2.1 time: 0.236981 Apr 14 00:20:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 353/745] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:20:36 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:20:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "name": "network-vif-deleted", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] Creating event network-vif-deleted:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:20:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035572 Apr 14 00:20:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 361/746] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503", "name": "network-vif-plugged", "status": "completed", "tag": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Creating event network-vif-plugged:9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 on user Apr 14 00:20:39 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Apr 14 00:20:39 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 354/747] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Creating event network-changed:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:20:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044441 Apr 14 00:20:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 362/748] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-plugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Creating event network-vif-plugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:20:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042426 Apr 14 00:20:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 355/749] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:49 user devstack@n-api.service[72775]: DEBUG neutronclient.v2_0.client [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Error message: {"NeutronError": {"type": "NetworkNotFound", "message": "Network 309f8474-d30d-4710-8b75-83ab15e20bad could not be found.", "detail": ""}} {{(pid=72775) _handle_fault_response /usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py:262}} Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Unexpected exception in API method: neutronclient.common.exceptions.NetworkNotFoundClient: Network 309f8474-d30d-4710-8b75-83ab15e20bad could not be found. Apr 14 00:20:49 user devstack@n-api.service[72775]: Neutron server returns request_ids: ['req-ed651bf5-b8ce-446f-b152-44da6ae14901'] Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2360, in create_resource_requests Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2170, in _get_physnet_tunneled_info Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi net = neutron.show_network( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 356, in get Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network 309f8474-d30d-4710-8b75-83ab15e20bad could not be found. Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed651bf5-b8ce-446f-b152-44da6ae14901'] Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Apr 14 00:20:49 user devstack@n-api.service[72775]: Apr 14 00:20:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Request method failure captured: Apr 14 00:20:49 user devstack@n-api.service[72775]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 00:20:49 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:20:49 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:20:49 user devstack@n-api.service[72775]: Connection: close Apr 14 00:20:49 user devstack@n-api.service[72775]: Content-Length: 1344 Apr 14 00:20:49 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:20:49 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:20:49 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:20:49 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJiZ2Tdom9Qg-0xldg5jDUWjl_0h5gu8sAT5K2vBdfOEpmTZGZxRKnt8EZ7seH4W66XR4Us_drYr69srOxtMgKJCECrRPjqmY4NQqZlZpAk198TOVmsm5eT2YQQTiz2olPa-UaGXZR1qJQNEE2U1zmHL3xj-j8sq-FmZfZgZqZYVhQc Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Project-Id: f8a7ace23ccb4c41b76a80532b3997b9 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Project-Name: tempest-TaggedBootDevicesTest-1396120968 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a7ace23ccb4c41b76a80532b3997b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a7ace23ccb4c41b76a80532b3997b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a7ace23ccb4c41b76a80532b3997b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Tenant: tempest-TaggedBootDevicesTest-1396120968 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Tenant-Id: f8a7ace23ccb4c41b76a80532b3997b9 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1396120968 Apr 14 00:20:49 user devstack@n-api.service[72775]: X-User: tempest-TaggedBootDevicesTest-1396120968-project-member Apr 14 00:20:49 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:20:49 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:20:49 user devstack@n-api.service[72775]: X-User-Id: f5613db231764f7c8c2ac461cf751d8e Apr 14 00:20:49 user devstack@n-api.service[72775]: X-User-Name: tempest-TaggedBootDevicesTest-1396120968-project-member Apr 14 00:20:49 user devstack@n-api.service[72775]: Apr 14 00:20:49 user devstack@n-api.service[72775]: {"server": {"name": "tempest-device-tagging-server-1263962017", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "85976ef7-a561-41c7-828a-692f13d81a25"}, {"port": "939a4ab4-87f9-4ad1-bcd0-c35f71660c09", "tag": "port-1"}, {"port": "2410de68-423e-40ed-a80a-bc26062a2675", "tag": "port-2"}, {"uuid": "309f8474-d30d-4710-8b75-83ab15e20bad", "tag": "net-1"}, {"uuid": "309f8474-d30d-4710-8b75-83ab15e20bad"}, {"uuid": "19ac8ed7-449a-45fc-a928-6ad38d22852b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "19ac8ed7-449a-45fc-a928-6ad38d22852b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f1a3323a-058c-4e1d-8627-04fbfb2310bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c61b919a-21cb-438b-aa6a-9876ba06231d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "20a8a1b6-5d63-4d2b-b3b1-a642c0690120", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1026616364"}], "key_name": "tempest-keypair-1627073537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Apr 14 00:20:49 user devstack@n-api.service[72775]: method: > Apr 14 00:20:49 user devstack@n-api.service[72775]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Apr 14 00:20:49 user devstack@n-api.service[72775]: Apr 14 00:20:49 user devstack@n-api.service[72775]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-1263962017', 'imageRef': '6db62068-7278-4cd8-b41f-d0140d89e199', 'flavorRef': '42', 'config_drive': True, 'networks': [{'uuid': '85976ef7-a561-41c7-828a-692f13d81a25'}, {'port': '939a4ab4-87f9-4ad1-bcd0-c35f71660c09', 'tag': 'port-1'}, {'port': '2410de68-423e-40ed-a80a-bc26062a2675', 'tag': 'port-2'}, {'uuid': '309f8474-d30d-4710-8b75-83ab15e20bad', 'tag': 'net-1'}, {'uuid': '309f8474-d30d-4710-8b75-83ab15e20bad'}, {'uuid': '19ac8ed7-449a-45fc-a928-6ad38d22852b', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '19ac8ed7-449a-45fc-a928-6ad38d22852b', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': 'c61b919a-21cb-438b-aa6a-9876ba06231d', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1026616364'}], 'key_name': 'tempest-keypair-1627073537', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Apr 14 00:20:49 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2360, in create_resource_requests Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2170, in _get_physnet_tunneled_info Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi net = neutron.show_network( Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 356, in get Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network 309f8474-d30d-4710-8b75-83ab15e20bad could not be found. Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed651bf5-b8ce-446f-b152-44da6ae14901'] Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:20:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Apr 14 00:20:49 user devstack@n-api.service[72775]: {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:20:49 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 500 len: 227 microversion: 2.32 time: 902.387667 Apr 14 00:20:49 user devstack@n-api.service[72775]: Fri Apr 14 00:20:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 00:20:49 user devstack@n-api.service[72775]: Fri Apr 14 00:20:49 2023 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.0.0.210) Apr 14 00:20:49 user devstack@n-api.service[72775]: CRITICAL nova [None req-aeab5395-be2d-46ab-a988-d2879ce5004a tempest-TaggedBootDevicesTest-1396120968 tempest-TaggedBootDevicesTest-1396120968-project-member] Unhandled error: OSError: write error Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova OSError: write error Apr 14 00:20:49 user devstack@n-api.service[72775]: ERROR nova Apr 14 00:20:49 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 33/750] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 00:05:46 2023] POST /compute/v2.1/servers => generated 0 bytes in 902392 msecs (HTTP/1.1 500) 9 headers in 0 bytes (0 switches on core 0) Apr 14 00:20:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-plugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Creating event network-vif-plugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:20:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 Apr 14 00:20:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 363/751] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:58 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "POST /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332/action" status: 202 len: 0 microversion: 2.87 time: 0.186366 Apr 14 00:20:58 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 356/752] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 00:20:57 2023] POST /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:58 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:20:58 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-98de1f8f-1f99-4258-bb64-96f8128d27f7 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1763 microversion: 2.87 time: 0.470718 Apr 14 00:20:58 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 34/753] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:20:58 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1763 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:20:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-unplugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:20:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:20:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:20:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:20:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Creating event network-vif-unplugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:20:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030654 Apr 14 00:20:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 364/754] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:20:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}, {"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:21:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:21:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049952 Apr 14 00:21:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 357/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:21:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:02 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:02 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:21:03 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035678 Apr 14 00:21:03 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 35/756] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:21:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:18 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:21:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-11de61ea-cddf-4e5c-92ee-027371ca38d6 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1705 microversion: 2.1 time: 0.293169 Apr 14 00:21:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 365/757] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:18 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1705 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-7d734717-fce1-4d02-94f3-259aa10227ca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.201804 Apr 14 00:21:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 358/758] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:21:22 2023] GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60/os-interface => generated 283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:23 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:23 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:23 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:23 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Creating event network-changed:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:21:23 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093976 Apr 14 00:21:23 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 36/759] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:21:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:27 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 HTTP/1.1 Apr 14 00:21:27 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:21:27 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:21:27 user devstack@n-api.service[72774]: Connection: close Apr 14 00:21:27 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:21:27 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:21:27 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:21:27 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:21:27 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:27 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:27 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:27 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:21:27 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:21:27 user devstack@n-api.service[72774]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:27 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:27 user devstack@n-api.service[72774]: method: > Apr 14 00:21:27 user devstack@n-api.service[72774]: exception: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:27 user devstack@n-api.service[72774]: action_args: {'id': 'fd5afe9f-e6b0-4564-a5cf-b4e0047a5503'} Apr 14 00:21:27 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:27 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:27 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f2ac2a52-ce41-48bf-81d7-c3dc20a71bfc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 404 len: 111 microversion: 2.1 time: 0.031259 Apr 14 00:21:27 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 366/760] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:27 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bfc84258-79d5-49a2-a614-b716e8e32125 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '.version_select at 0x7f3db67a76d0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bfc84258-79d5-49a2-a614-b716e8e32125 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861608591" status: 202 len: 0 microversion: 2.1 time: 0.029167 Apr 14 00:21:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 359/761] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:21:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861608591 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1594608317", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e"}], "security_groups": [{"name": "tempest-securitygroup--155365803"}], "key_name": "tempest-keypair-1040271550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7056196a-d087-4a9b-a3c8-350b13e6d2c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] validate_networks() for [('cb8c9bb1-a885-486d-aa6a-de600bc01c2e', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:21:27 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:21:27 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-7bfbd52b-b130-4ded-9bf9-715f8d568d59 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1550 microversion: 2.1 time: 0.416903 Apr 14 00:21:27 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 37/762] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:27 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1550 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:21:27 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7056196a-d087-4a9b-a3c8-350b13e6d2c3',volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:21:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.780806 Apr 14 00:21:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 367/763] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:21:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:21:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4a041c75-635e-49e4-a654-ab18f26509f6 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4a041c75-635e-49e4-a654-ab18f26509f6 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4a041c75-635e-49e4-a654-ab18f26509f6 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:21:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4a041c75-635e-49e4-a654-ab18f26509f6 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1076 microversion: 2.1 time: 0.071651 Apr 14 00:21:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 360/764] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:28 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1076 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:21:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Creating event network-changed:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:21:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037776 Apr 14 00:21:30 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 38/765] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:31 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 HTTP/1.1 Apr 14 00:21:31 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:21:31 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:21:31 user devstack@n-api.service[72774]: Connection: close Apr 14 00:21:31 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:21:31 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:21:31 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:21:31 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:21:31 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:31 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:31 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:31 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:21:31 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:21:31 user devstack@n-api.service[72774]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:31 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:31 user devstack@n-api.service[72774]: method: > Apr 14 00:21:31 user devstack@n-api.service[72774]: exception: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72774]: action_args: {'id': 'fd5afe9f-e6b0-4564-a5cf-b4e0047a5503'} Apr 14 00:21:31 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9bdd8a45-4183-41de-a525-b80049a2eade tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 404 len: 111 microversion: 2.1 time: 0.029014 Apr 14 00:21:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 368/766] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:21:31 2023] DELETE /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:31 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 HTTP/1.1 Apr 14 00:21:31 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:21:31 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:21:31 user devstack@n-api.service[72773]: Connection: close Apr 14 00:21:31 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:21:31 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:21:31 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:21:31 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:21:31 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:31 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:31 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:31 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:21:31 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:21:31 user devstack@n-api.service[72773]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:31 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:31 user devstack@n-api.service[72773]: method: > Apr 14 00:21:31 user devstack@n-api.service[72773]: exception: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72773]: action_args: {'id': 'fd5afe9f-e6b0-4564-a5cf-b4e0047a5503'} Apr 14 00:21:31 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. Apr 14 00:21:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-085546ab-2378-4af1-8293-ab0f61bf42a6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" status: 404 len: 111 microversion: 2.1 time: 0.050463 Apr 14 00:21:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 361/767] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:31 2023] GET /compute/v2.1/servers/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:34 user devstack@n-api.service[72775]: request: DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 HTTP/1.1 Apr 14 00:21:34 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:21:34 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:21:34 user devstack@n-api.service[72775]: Connection: close Apr 14 00:21:34 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:21:34 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:21:34 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:21:34 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:21:34 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72775]: method: > Apr 14 00:21:34 user devstack@n-api.service[72775]: exception: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: action_args: {'id': 'e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8'} Apr 14 00:21:34 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-c31fd656-674e-42c4-9681-2be9bb553836 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 404 len: 111 microversion: 2.1 time: 0.038734 Apr 14 00:21:34 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 39/768] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:21:34 2023] DELETE /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:34 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 HTTP/1.1 Apr 14 00:21:34 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:21:34 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:21:34 user devstack@n-api.service[72774]: Connection: close Apr 14 00:21:34 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:21:34 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:21:34 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:21:34 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:21:34 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72774]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72774]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:34 user devstack@n-api.service[72774]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72774]: method: > Apr 14 00:21:34 user devstack@n-api.service[72774]: exception: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72774]: action_args: {'id': 'e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8'} Apr 14 00:21:34 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-29d781d3-72da-49f2-bea1-5640cb2fb00f tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" status: 404 len: 111 microversion: 2.1 time: 0.040348 Apr 14 00:21:34 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 369/769] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:34 2023] GET /compute/v2.1/servers/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:34 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 HTTP/1.1 Apr 14 00:21:34 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:21:34 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:21:34 user devstack@n-api.service[72773]: Connection: close Apr 14 00:21:34 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:21:34 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:21:34 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:21:34 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:21:34 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72773]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:34 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72773]: method: > Apr 14 00:21:34 user devstack@n-api.service[72773]: exception: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72773]: action_args: {'id': 'b21b91b1-a98b-48c7-a2e8-4114c3e31345'} Apr 14 00:21:34 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:34 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ee05c894-934f-4206-bad9-741ec84b9f47 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 404 len: 111 microversion: 2.1 time: 0.035719 Apr 14 00:21:34 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 362/770] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:21:34 2023] DELETE /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:34 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 HTTP/1.1 Apr 14 00:21:34 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:21:34 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:21:34 user devstack@n-api.service[72775]: Connection: close Apr 14 00:21:34 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:21:34 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:21:34 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:21:34 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:21:34 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:34 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:34 user devstack@n-api.service[72775]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:34 user devstack@n-api.service[72775]: method: > Apr 14 00:21:34 user devstack@n-api.service[72775]: exception: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: action_args: {'id': 'b21b91b1-a98b-48c7-a2e8-4114c3e31345'} Apr 14 00:21:34 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. Apr 14 00:21:34 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-65b3158b-d6c3-48d3-940b-3a0b739bed21 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345" status: 404 len: 111 microversion: 2.1 time: 0.032709 Apr 14 00:21:34 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 40/771] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:34 2023] GET /compute/v2.1/servers/b21b91b1-a98b-48c7-a2e8-4114c3e31345 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 00:21:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-plugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Creating event network-vif-plugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:21:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112732 Apr 14 00:21:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 370/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:38 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c HTTP/1.1 Apr 14 00:21:38 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:21:38 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:21:38 user devstack@n-api.service[72773]: Connection: close Apr 14 00:21:38 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:21:38 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:21:38 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:21:38 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:21:38 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:38 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:38 user devstack@n-api.service[72773]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:38 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:21:38 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:21:38 user devstack@n-api.service[72773]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:38 user devstack@n-api.service[72773]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:38 user devstack@n-api.service[72773]: method: > Apr 14 00:21:38 user devstack@n-api.service[72773]: exception: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72773]: action_args: {'id': 'e3fba4ee-4aae-4ee3-8114-b53510f5442c'} Apr 14 00:21:38 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-61b2584f-2bc4-4c5b-866d-a4ff54257ead tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 404 len: 111 microversion: 2.1 time: 0.036211 Apr 14 00:21:38 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 363/773] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:21:38 2023] DELETE /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:38 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HTTP exception thrown: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Request method failure captured: Apr 14 00:21:38 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c HTTP/1.1 Apr 14 00:21:38 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:21:38 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:21:38 user devstack@n-api.service[72775]: Connection: close Apr 14 00:21:38 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:21:38 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:21:38 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:21:38 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:21:38 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJk2c2pbM5IR0f5wb1tQD6WQ3L_-QKdoD-jblLRhXMJRU5_c8YCmF0MlzmDzNEtd-Enght1UTVMa3hCAozJLWIzuCUBw-r4PHg9tHoKqrIHjA0N-RMG7dk4rGdMLImjpDEwYSwz77VOZvZjjSdyXTetCW7OkZ4xD9riXFH4OdDw_mi4 Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Project-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Project-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/44c9d67ad2fa4cb9ab309b98f8fe051a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Tenant: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Tenant-Id: 44c9d67ad2fa4cb9ab309b98f8fe051a Apr 14 00:21:38 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-719597397 Apr 14 00:21:38 user devstack@n-api.service[72775]: X-User: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:38 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:21:38 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:21:38 user devstack@n-api.service[72775]: X-User-Id: fb293fdfc658466aaa7134269fa46a7c Apr 14 00:21:38 user devstack@n-api.service[72775]: X-User-Name: tempest-AttachVolumeNegativeTest-719597397-project-member Apr 14 00:21:38 user devstack@n-api.service[72775]: method: > Apr 14 00:21:38 user devstack@n-api.service[72775]: exception: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72775]: action_args: {'id': 'e3fba4ee-4aae-4ee3-8114-b53510f5442c'} Apr 14 00:21:38 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. Apr 14 00:21:38 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:21:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Returning 404 to user: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:21:38 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-5c105ce1-9795-45b5-8738-589d70bc36dc tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c" status: 404 len: 111 microversion: 2.1 time: 0.031690 Apr 14 00:21:38 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 41/774] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:21:38 2023] GET /compute/v2.1/servers/e3fba4ee-4aae-4ee3-8114-b53510f5442c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:21:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-plugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:21:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Creating event network-vif-plugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:21:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039319 Apr 14 00:21:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 371/775] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:21:48 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:21:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:21:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:21:49 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:21:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9b29c468-c336-40bd-ba21-5fcc331ac359 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1769 microversion: 2.87 time: 0.418215 Apr 14 00:21:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 364/776] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:21:48 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1769 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=12 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=16 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:18 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:22:18 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-1882ccbc-6861-4025-90aa-06f00c50a3c2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1428 microversion: 2.1 time: 0.159990 Apr 14 00:22:18 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 42/777] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:22:18 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=18 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] HTTP exception thrown: Cannot 'detach_volume' instance ade24ab6-1a93-4449-b5e9-ec3de357665b while it is in vm_state rescued Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Request method failure captured: Apr 14 00:22:18 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments/0c953a4d-d77b-4d17-bcad-ea49b45adbb9 HTTP/1.1 Apr 14 00:22:18 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:22:18 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:22:18 user devstack@n-api.service[72774]: Connection: close Apr 14 00:22:18 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:22:18 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:22:18 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:22:18 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:22:18 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJnU9NoR16K4jD4Bh4PI7TXl-Wss5ITDouS9HFhRkZkEP6TA5ATNRb-lCaL6WqWoz32ly5ZoyLfoHcZi1_01Txos1P9o-ypWg3-KePDlInNnXk4z6Me7CNMVmwr0BIQrDnY1C11VQALNxSPTQ_soH50f30qTk_dF25qZIhQIj6TnwmI Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Project-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Tenant-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-User: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:22:18 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:22:18 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:22:18 user devstack@n-api.service[72774]: X-User-Id: f43f3171ccad4167ac783bbdfe2df478 Apr 14 00:22:18 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:22:18 user devstack@n-api.service[72774]: method: > Apr 14 00:22:18 user devstack@n-api.service[72774]: exception: Cannot 'detach_volume' instance ade24ab6-1a93-4449-b5e9-ec3de357665b while it is in vm_state rescued Apr 14 00:22:18 user devstack@n-api.service[72774]: action_args: {'server_id': 'ade24ab6-1a93-4449-b5e9-ec3de357665b', 'id': '0c953a4d-d77b-4d17-bcad-ea49b45adbb9'} Apr 14 00:22:18 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ade24ab6-1a93-4449-b5e9-ec3de357665b while it is in vm_state rescued Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ade24ab6-1a93-4449-b5e9-ec3de357665b while it is in vm_state rescued Apr 14 00:22:18 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:22:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Returning 409 to user: Cannot 'detach_volume' instance ade24ab6-1a93-4449-b5e9-ec3de357665b while it is in vm_state rescued {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:22:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-32d998aa-1895-4f2f-a7ea-c4c4f8775e4a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments/0c953a4d-d77b-4d17-bcad-ea49b45adbb9" status: 409 len: 152 microversion: 2.1 time: 0.103485 Apr 14 00:22:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 372/778] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:22:18 2023] DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments/0c953a4d-d77b-4d17-bcad-ea49b45adbb9 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/action" status: 202 len: 0 microversion: 2.1 time: 0.086495 Apr 14 00:22:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 365/779] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:22:18 2023] POST /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:19 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:22:19 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-37ffa816-0898-4e0b-8d05-5beb9b99c3a4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1713 microversion: 2.1 time: 0.146132 Apr 14 00:22:19 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 43/780] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:22:19 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1713 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:22:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-unplugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Creating event network-vif-unplugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:22:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030808 Apr 14 00:22:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 373/781] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}, {"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}, {"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:22:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:22:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:22:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034843 Apr 14 00:22:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 366/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:29 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Going to try to terminate instance {{(pid=72775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:22:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Creating event network-changed:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:22:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033694 Apr 14 00:22:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 374/783] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:29 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 204 len: 0 microversion: 2.1 time: 0.167199 Apr 14 00:22:29 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 44/784] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:22:29 2023] DELETE /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:29 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:22:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ac2f8b69-4d25-4bc9-82d9-931ea161eb53 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 200 len: 1556 microversion: 2.1 time: 0.361240 Apr 14 00:22:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 367/785] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:22:29 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 1556 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-unplugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Creating event network-vif-unplugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:22:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031089 Apr 14 00:22:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 375/786] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:31 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-plugged", "status": "completed", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}, {"server_uuid": "c7e1f470-fe8a-455e-aa0b-0d2475957fc0", "name": "network-vif-deleted", "tag": "0f90a627-4dab-4a2a-a2c2-eaae2910b379"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:31 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Creating event network-vif-plugged:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:22:31 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Creating event network-vif-deleted:0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 on user Apr 14 00:22:31 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054206 Apr 14 00:22:31 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 45/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:22:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 204 len: 0 microversion: 2.87 time: 0.123743 Apr 14 00:22:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 368/788] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:22:49 2023] DELETE /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=12 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:22:49 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:22:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-97ceacee-741a-4f7b-9a45-7d9875d9935c tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 200 len: 1775 microversion: 2.87 time: 0.191694 Apr 14 00:22:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 376/789] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:22:49 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 1775 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:22:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-unplugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:49 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:49 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:49 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Creating event network-vif-unplugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:22:49 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040308 Apr 14 00:22:49 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 46/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-deleted", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] Creating event network-vif-deleted:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:22:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030048 Apr 14 00:22:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 369/791] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:22:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a94e92-54cf-49b7-ae71-32b3c48df332", "name": "network-vif-plugged", "status": "completed", "tag": "4788878b-ac88-49ff-a42d-df57ef410442"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:22:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:22:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:22:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:22:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Creating event network-vif-plugged:4788878b-ac88-49ff-a42d-df57ef410442 for instance 13a94e92-54cf-49b7-ae71-32b3c48df332 on user Apr 14 00:22:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029845 Apr 14 00:22:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 377/792] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:22:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:09 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:09 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-860d64bd-52f5-4516-8822-989c8c060d84 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1719 microversion: 2.1 time: 0.186203 Apr 14 00:23:09 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 47/793] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:23:09 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:18 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-81687e45-30f2-4fd9-9730-089c0ec76361 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.103224 Apr 14 00:23:18 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 370/794] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:23:18 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Creating event network-changed:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048483 Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 378/795] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:19 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f8c7eefa-7097-4f0f-808f-edadf924e97c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1428 microversion: 2.1 time: 0.168824 Apr 14 00:23:19 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 48/796] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:23:19 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1428 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] HTTP exception thrown: Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 could not be found. Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Request method failure captured: Apr 14 00:23:19 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 HTTP/1.1 Apr 14 00:23:19 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:23:19 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:23:19 user devstack@n-api.service[72773]: Connection: close Apr 14 00:23:19 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:23:19 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:23:19 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:23:19 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:23:19 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJtlkxUHFjwQlc4rXMorxcgBg2aji47PeSjn5UHaien8hSwTdcD_ISAyM58bubKIQmh3f4zw7jSj64LvttUdLVveVa2DgChB60oJ525QIFXm7zZD7sg0k069-gk5IV_itAU87EiZxu8BYQkR1EycTRub_qEei-Ex4SQxV58qhFoTkTM Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Project-Id: e6be95e5c8d94269802ecf487ff73104 Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Project-Name: tempest-TestShelveInstance-5222591 Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6be95e5c8d94269802ecf487ff73104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6be95e5c8d94269802ecf487ff73104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6be95e5c8d94269802ecf487ff73104"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Tenant: tempest-TestShelveInstance-5222591 Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Tenant-Id: e6be95e5c8d94269802ecf487ff73104 Apr 14 00:23:19 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TestShelveInstance-5222591 Apr 14 00:23:19 user devstack@n-api.service[72773]: X-User: tempest-TestShelveInstance-5222591-project-member Apr 14 00:23:19 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:23:19 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:23:19 user devstack@n-api.service[72773]: X-User-Id: b81e5ce5d2414980a506d0f3b37d0d5c Apr 14 00:23:19 user devstack@n-api.service[72773]: X-User-Name: tempest-TestShelveInstance-5222591-project-member Apr 14 00:23:19 user devstack@n-api.service[72773]: method: > Apr 14 00:23:19 user devstack@n-api.service[72773]: exception: Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 could not be found. Apr 14 00:23:19 user devstack@n-api.service[72773]: action_args: {'id': 'c7e1f470-fe8a-455e-aa0b-0d2475957fc0'} Apr 14 00:23:19 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 could not be found. Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 could not be found. Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 could not be found. Apr 14 00:23:19 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Returning 404 to user: Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:23:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e2619a45-3d82-42f2-8e63-b46c014318b4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0" status: 404 len: 111 microversion: 2.1 time: 0.041778 Apr 14 00:23:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 371/797] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:23:19 2023] GET /compute/v2.1/servers/c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Old instance type m1.nano, new instance type m1.micro {{(pid=72774) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting quotas for user 3d86662f2c7648daad87118b7e9f757c and project bf8663ccad9047f4b11b9ae0646c287a. Resources: {'cores', 'ram'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:23:19 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:23:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/action" status: 202 len: 0 microversion: 2.1 time: 0.176200 Apr 14 00:23:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 379/798] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:23:19 2023] POST /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:19 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9503cbb7-50d0-439d-9cd1-1406feacf6d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Calling method '.version_select at 0x7f3db67a5630>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9503cbb7-50d0-439d-9cd1-1406feacf6d4 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-266505447" status: 202 len: 0 microversion: 2.1 time: 0.025258 Apr 14 00:23:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 372/799] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 00:23:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-266505447 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:23:19 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:19 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-af7dddd2-38bb-4659-a407-97ea150b6b3b tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1437 microversion: 2.1 time: 0.170680 Apr 14 00:23:19 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 49/800] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:23:19 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1437 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:23:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Creating event network-changed:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:23:21 user devstack@n-api.service[72774]: DEBUG nova.compute.api [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:23:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049565 Apr 14 00:23:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 380/801] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-unplugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Creating event network-vif-unplugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:23:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72773) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:23:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047015 Apr 14 00:23:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 373/802] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:24 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-plugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:24 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:24 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:24 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:24 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Creating event network-vif-plugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:23:24 user devstack@n-api.service[72775]: DEBUG nova.compute.api [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72775) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:23:24 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047336 Apr 14 00:23:24 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 50/803] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-plugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=18 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Creating event network-vif-plugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:23:33 user devstack@n-api.service[72774]: DEBUG nova.compute.api [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:23:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072032 Apr 14 00:23:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 381/804] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-plugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Creating event network-vif-plugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:23:35 user devstack@n-api.service[72773]: DEBUG nova.compute.api [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72773) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 00:23:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059269 Apr 14 00:23:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 374/805] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=16 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HTTP exception thrown: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Request method failure captured: Apr 14 00:23:39 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 HTTP/1.1 Apr 14 00:23:39 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:23:39 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:23:39 user devstack@n-api.service[72775]: Connection: close Apr 14 00:23:39 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:23:39 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:23:39 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:23:39 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:23:39 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJiikT79fRQrBz1VpqwOZdLTh2wosKV5hl8rqjvOEa1B0rzZYCTNTswHebMkK0KVDnsNU_HoegkPOKw9RfBIkWt0B3G1AqSsg2feFKpoT1sqahFLVLF9E8TYFu4FU11z2J589Fi7pcw3jZMPQVJWjD_jEjiqqJ7crlGpIuShgCPI1n4 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Project-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Tenant-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:23:39 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:23:39 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:23:39 user devstack@n-api.service[72775]: X-User-Id: 90bad96535c3453792982c5acab9dbc6 Apr 14 00:23:39 user devstack@n-api.service[72775]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:23:39 user devstack@n-api.service[72775]: method: > Apr 14 00:23:39 user devstack@n-api.service[72775]: exception: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. Apr 14 00:23:39 user devstack@n-api.service[72775]: action_args: {'id': '13a94e92-54cf-49b7-ae71-32b3c48df332'} Apr 14 00:23:39 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. Apr 14 00:23:39 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:23:39 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Returning 404 to user: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:23:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-8eff15a3-04ad-45c9-976d-ef13a641bab0 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332" status: 404 len: 111 microversion: 2.87 time: 0.042110 Apr 14 00:23:39 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 51/806] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:23:39 2023] GET /compute/v2.1/servers/13a94e92-54cf-49b7-ae71-32b3c48df332 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:23:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb" status: 204 len: 0 microversion: 2.87 time: 0.123793 Apr 14 00:23:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 382/807] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:23:39 2023] DELETE /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:39 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:40 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:40 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:40 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:23:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-18314205-80fd-4778-8b50-5d5966681515 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb" status: 200 len: 1698 microversion: 2.87 time: 0.209059 Apr 14 00:23:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 375/808] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:23:39 2023] GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb => generated 1698 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:23:40 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2793d412-f405-4452-8e46-c192e3c92ccb", "name": "network-vif-unplugged", "status": "completed", "tag": "47e07f85-3946-4934-a2ec-c9c77ccc3761"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:40 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Creating event network-vif-unplugged:47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance 2793d412-f405-4452-8e46-c192e3c92ccb on user Apr 14 00:23:40 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030482 Apr 14 00:23:40 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 52/809] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2793d412-f405-4452-8e46-c192e3c92ccb", "name": "network-vif-deleted", "tag": "47e07f85-3946-4934-a2ec-c9c77ccc3761"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] Creating event network-vif-deleted:47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance 2793d412-f405-4452-8e46-c192e3c92ccb on user Apr 14 00:23:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Apr 14 00:23:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 383/810] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:23:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2793d412-f405-4452-8e46-c192e3c92ccb", "name": "network-vif-plugged", "status": "completed", "tag": "47e07f85-3946-4934-a2ec-c9c77ccc3761"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:23:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:23:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:23:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:23:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Creating event network-vif-plugged:47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance 2793d412-f405-4452-8e46-c192e3c92ccb on user Apr 14 00:23:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040267 Apr 14 00:23:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 376/811] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:09 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:09 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-68d85f8c-6e35-4408-8a3f-300bca478d6d tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.108522 Apr 14 00:24:09 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 53/812] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 00:24:09 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-interface => generated 283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:10 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:24:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-2e01c6c5-f44d-476d-87b7-73a7991b6e3f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1555 microversion: 2.1 time: 0.163455 Apr 14 00:24:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 384/813] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:24:10 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:24:10 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:10 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=12 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:24:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Creating event network-changed:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:24:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041515 Apr 14 00:24:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 377/814] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:24:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:11 user devstack@n-api.service[72775]: DEBUG nova.objects.instance [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'services' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=72775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:24:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments/0c953a4d-d77b-4d17-bcad-ea49b45adbb9" status: 202 len: 0 microversion: 2.1 time: 0.258221 Apr 14 00:24:11 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 54/815] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:24:10 2023] DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments/0c953a4d-d77b-4d17-bcad-ea49b45adbb9 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7800259a-00cf-4487-9792-cc72b11e1449 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Apr 14 00:24:11 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 385/816] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:24:11 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:24:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:24:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Creating event network-changed:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:24:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031195 Apr 14 00:24:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 378/817] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:24:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HTTP exception thrown: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Request method failure captured: Apr 14 00:24:30 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb HTTP/1.1 Apr 14 00:24:30 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:24:30 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:24:30 user devstack@n-api.service[72775]: Connection: close Apr 14 00:24:30 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:24:30 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:24:30 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:24:30 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:24:30 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJiikT79fRQrBz1VpqwOZdLTh2wosKV5hl8rqjvOEa1B0rzZYCTNTswHebMkK0KVDnsNU_HoegkPOKw9RfBIkWt0B3G1AqSsg2feFKpoT1sqahFLVLF9E8TYFu4FU11z2J589Fi7pcw3jZMPQVJWjD_jEjiqqJ7crlGpIuShgCPI1n4 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Project-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Tenant-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:24:30 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:24:30 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:24:30 user devstack@n-api.service[72775]: X-User-Id: 90bad96535c3453792982c5acab9dbc6 Apr 14 00:24:30 user devstack@n-api.service[72775]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:24:30 user devstack@n-api.service[72775]: method: > Apr 14 00:24:30 user devstack@n-api.service[72775]: exception: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. Apr 14 00:24:30 user devstack@n-api.service[72775]: action_args: {'id': '2793d412-f405-4452-8e46-c192e3c92ccb'} Apr 14 00:24:30 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. Apr 14 00:24:30 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Returning 404 to user: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:24:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-0862d6c7-69c3-4437-bab1-a02f9dcb85c1 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb" status: 404 len: 111 microversion: 2.87 time: 0.037647 Apr 14 00:24:30 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 55/818] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:24:30 2023] GET /compute/v2.1/servers/2793d412-f405-4452-8e46-c192e3c92ccb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=12 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:24:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 204 len: 0 microversion: 2.87 time: 0.117745 Apr 14 00:24:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 386/819] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:24:30 2023] DELETE /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:24:30 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:24:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a0db7b1f-9d55-4ae8-9ea0-4a25969e7140 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 200 len: 1776 microversion: 2.87 time: 0.215145 Apr 14 00:24:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 379/820] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:24:30 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 1776 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-unplugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:30 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Creating event network-vif-unplugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:24:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030860 Apr 14 00:24:30 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 56/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:24:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:24:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-deleted", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:24:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] Creating event network-vif-deleted:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:24:32 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038133 Apr 14 00:24:32 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 387/822] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:24:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:24:32 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6c147-fb62-4204-a416-792b94d3f7dd", "name": "network-vif-plugged", "status": "completed", "tag": "102987de-d5e4-4ccd-b4fd-7ca7c131e379"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:24:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:24:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:24:32 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:24:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Creating event network-vif-plugged:102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance 17c6c147-fb62-4204-a416-792b94d3f7dd on user Apr 14 00:24:32 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052106 Apr 14 00:24:32 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 380/823] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:24:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-d31736e7-51d2-43c1-80fa-259dcdc2d849 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047949 Apr 14 00:25:01 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 57/824] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:25:01 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:25:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 204 len: 0 microversion: 2.1 time: 0.123575 Apr 14 00:25:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 388/825] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:25:01 2023] DELETE /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:25:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ecb55a5d-abb9-40ec-a895-c41fdb0616cf tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 200 len: 1679 microversion: 2.1 time: 0.262146 Apr 14 00:25:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 381/826] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:25:01 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-unplugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Creating event network-vif-unplugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:25:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030282 Apr 14 00:25:01 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 58/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:25:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:25:03 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-plugged", "status": "completed", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}, {"server_uuid": "ade24ab6-1a93-4449-b5e9-ec3de357665b", "name": "network-vif-deleted", "tag": "11344eed-48f5-49c5-a770-c9c298f7185e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:25:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:03 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Creating event network-vif-plugged:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:25:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Creating event network-vif-deleted:11344eed-48f5-49c5-a770-c9c298f7185e for instance ade24ab6-1a93-4449-b5e9-ec3de357665b on user Apr 14 00:25:03 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053437 Apr 14 00:25:03 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 389/828] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:25:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:10 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:10 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/action" status: 204 len: 0 microversion: 2.1 time: 0.144596 Apr 14 00:25:10 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 382/829] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:25:10 2023] POST /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/action => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:10 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:25:10 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-6e417ce5-bf08-4bdc-a77d-a17ab9167c09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1555 microversion: 2.1 time: 0.203759 Apr 14 00:25:10 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 59/830] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:25:10 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HTTP exception thrown: Instance 17c6c147-fb62-4204-a416-792b94d3f7dd could not be found. Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Request method failure captured: Apr 14 00:25:20 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd HTTP/1.1 Apr 14 00:25:20 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:25:20 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:25:20 user devstack@n-api.service[72774]: Connection: close Apr 14 00:25:20 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:25:20 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:25:20 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:25:20 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:25:20 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiikT79fRQrBz1VpqwOZdLTh2wosKV5hl8rqjvOEa1B0rzZYCTNTswHebMkK0KVDnsNU_HoegkPOKw9RfBIkWt0B3G1AqSsg2feFKpoT1sqahFLVLF9E8TYFu4FU11z2J589Fi7pcw3jZMPQVJWjD_jEjiqqJ7crlGpIuShgCPI1n4 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Project-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Tenant-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:25:20 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:25:20 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:25:20 user devstack@n-api.service[72774]: X-User-Id: 90bad96535c3453792982c5acab9dbc6 Apr 14 00:25:20 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:25:20 user devstack@n-api.service[72774]: method: > Apr 14 00:25:20 user devstack@n-api.service[72774]: exception: Instance 17c6c147-fb62-4204-a416-792b94d3f7dd could not be found. Apr 14 00:25:20 user devstack@n-api.service[72774]: action_args: {'id': '17c6c147-fb62-4204-a416-792b94d3f7dd'} Apr 14 00:25:20 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c6c147-fb62-4204-a416-792b94d3f7dd could not be found. Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c6c147-fb62-4204-a416-792b94d3f7dd could not be found. Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c6c147-fb62-4204-a416-792b94d3f7dd could not be found. Apr 14 00:25:20 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:25:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Returning 404 to user: Instance 17c6c147-fb62-4204-a416-792b94d3f7dd could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:25:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7d324790-927b-44a5-82d3-7a7825d2d0a9 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd" status: 404 len: 111 microversion: 2.87 time: 0.040061 Apr 14 00:25:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 390/831] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:25:20 2023] GET /compute/v2.1/servers/17c6c147-fb62-4204-a416-792b94d3f7dd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:20 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:25:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 204 len: 0 microversion: 2.87 time: 0.171113 Apr 14 00:25:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 383/832] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 00:25:20 2023] DELETE /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=14 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:25:21 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:25:21 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-a381fbfa-702d-4733-8613-5bb435c20c09 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 200 len: 1696 microversion: 2.87 time: 0.182381 Apr 14 00:25:21 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 60/833] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:25:21 2023] GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 00:25:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23718fd0-58b8-47f9-b1ef-a26a90741ecc", "name": "network-vif-unplugged", "status": "completed", "tag": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:25:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Creating event network-vif-unplugged:db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc on user Apr 14 00:25:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034357 Apr 14 00:25:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 391/834] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:25:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:25:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23718fd0-58b8-47f9-b1ef-a26a90741ecc", "name": "network-vif-plugged", "status": "completed", "tag": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3"}, {"server_uuid": "23718fd0-58b8-47f9-b1ef-a26a90741ecc", "name": "network-vif-deleted", "tag": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:25:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Creating event network-vif-plugged:db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc on user Apr 14 00:25:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Creating event network-vif-deleted:db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc on user Apr 14 00:25:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032904 Apr 14 00:25:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 384/835] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:25:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:51 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] HTTP exception thrown: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b could not be found. Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Request method failure captured: Apr 14 00:25:51 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b HTTP/1.1 Apr 14 00:25:51 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:25:51 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:25:51 user devstack@n-api.service[72775]: Connection: close Apr 14 00:25:51 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:25:51 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:25:51 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:25:51 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:25:51 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJnU9NoR16K4jD4Bh4PI7TXl-Wss5ITDouS9HFhRkZkEP6TA5ATNRb-lCaL6WqWoz32ly5ZoyLfoHcZi1_01Txos1P9o-ypWg3-KePDlInNnXk4z6Me7CNMVmwr0BIQrDnY1C11VQALNxSPTQ_soH50f30qTk_dF25qZIhQIj6TnwmI Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Project-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Tenant-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-User: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:25:51 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:25:51 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:25:51 user devstack@n-api.service[72775]: X-User-Id: f43f3171ccad4167ac783bbdfe2df478 Apr 14 00:25:51 user devstack@n-api.service[72775]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:25:51 user devstack@n-api.service[72775]: method: > Apr 14 00:25:51 user devstack@n-api.service[72775]: exception: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b could not be found. Apr 14 00:25:51 user devstack@n-api.service[72775]: action_args: {'id': 'ade24ab6-1a93-4449-b5e9-ec3de357665b'} Apr 14 00:25:51 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b could not be found. Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b could not be found. Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b could not be found. Apr 14 00:25:51 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:25:51 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Returning 404 to user: Instance ade24ab6-1a93-4449-b5e9-ec3de357665b could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:25:51 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-cae18bd9-79c3-4a44-b6c2-f9e36079de7b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b" status: 404 len: 111 microversion: 2.1 time: 0.032953 Apr 14 00:25:51 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 61/836] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:25:51 2023] GET /compute/v2.1/servers/ade24ab6-1a93-4449-b5e9-ec3de357665b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:25:51 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:51 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-854732f1-9483-4784-b16a-d93caf5f3f46 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '.version_select at 0x7f3db6743400>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-854732f1-9483-4784-b16a-d93caf5f3f46 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020248029" status: 202 len: 0 microversion: 2.1 time: 0.048045 Apr 14 00:25:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 392/837] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:25:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020248029 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:59 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:25:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 204 len: 0 microversion: 2.1 time: 0.120875 Apr 14 00:25:59 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 385/838] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:25:59 2023] DELETE /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:59 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:25:59 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-ee540430-22d5-4180-965e-6ac483e1b5b4 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 200 len: 1495 microversion: 2.1 time: 0.255724 Apr 14 00:25:59 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 62/839] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:25:59 2023] GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 1495 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:25:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-unplugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:25:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:25:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:25:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:25:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Creating event network-vif-unplugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:25:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091742 Apr 14 00:25:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 393/840] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:00 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:26:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-c41b31b5-7d9e-4bb9-a720-8e304e4612d2 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1547 microversion: 2.1 time: 0.216555 Apr 14 00:26:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 386/841] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:26:00 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1547 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:26:01 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-plugged", "status": "completed", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}, {"server_uuid": "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c", "name": "network-vif-deleted", "tag": "caaa85dc-5a5f-4480-b6be-b2bc234cd455"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Creating event network-vif-plugged:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:26:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Creating event network-vif-deleted:caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c on user Apr 14 00:26:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043787 Apr 14 00:26:01 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 63/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HTTP exception thrown: Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc could not be found. Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Request method failure captured: Apr 14 00:26:11 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc HTTP/1.1 Apr 14 00:26:11 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:26:11 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:26:11 user devstack@n-api.service[72774]: Connection: close Apr 14 00:26:11 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:26:11 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:26:11 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:26:11 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:26:11 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiikT79fRQrBz1VpqwOZdLTh2wosKV5hl8rqjvOEa1B0rzZYCTNTswHebMkK0KVDnsNU_HoegkPOKw9RfBIkWt0B3G1AqSsg2feFKpoT1sqahFLVLF9E8TYFu4FU11z2J589Fi7pcw3jZMPQVJWjD_jEjiqqJ7crlGpIuShgCPI1n4 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Project-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba3f111e24414976beddba7ef90c4793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Tenant-Id: ba3f111e24414976beddba7ef90c4793 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:26:11 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:26:11 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:26:11 user devstack@n-api.service[72774]: X-User-Id: 90bad96535c3453792982c5acab9dbc6 Apr 14 00:26:11 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member Apr 14 00:26:11 user devstack@n-api.service[72774]: method: > Apr 14 00:26:11 user devstack@n-api.service[72774]: exception: Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc could not be found. Apr 14 00:26:11 user devstack@n-api.service[72774]: action_args: {'id': '23718fd0-58b8-47f9-b1ef-a26a90741ecc'} Apr 14 00:26:11 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc could not be found. Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc could not be found. Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc could not be found. Apr 14 00:26:11 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Returning 404 to user: Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:26:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-733bac5a-7a1e-4d6e-8feb-de3552df4f98 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc" status: 404 len: 111 microversion: 2.87 time: 0.033424 Apr 14 00:26:11 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 394/843] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 00:26:11 2023] GET /compute/v2.1/servers/23718fd0-58b8-47f9-b1ef-a26a90741ecc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:26:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-770201332", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "83abe289-89d1-4c43-bfc5-19bcfdcc8309"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:29 user devstack@n-api.service[72773]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] validate_networks() for [('83abe289-89d1-4c43-bfc5-19bcfdcc8309', None, None, None, None, None)] {{(pid=72773) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting quotas for project 851640ccdac240bcb6b9b0a89dd250d8. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting quotas for user f922c56244e442028d3265b23a8fffd5 and project 851640ccdac240bcb6b9b0a89dd250d8. Resources: {'cores', 'ram', 'instances'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Going to run 1 instances... {{(pid=72773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:26:30 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:26:30 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.566233 Apr 14 00:26:30 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 387/844] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:26:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:26:30 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:30 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=10 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:30 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-9fcbe4de-9654-4a99-a190-caa80a639c1c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:26:30 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-9fcbe4de-9654-4a99-a190-caa80a639c1c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:26:30 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-9fcbe4de-9654-4a99-a190-caa80a639c1c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:26:30 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-9fcbe4de-9654-4a99-a190-caa80a639c1c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1" status: 200 len: 1212 microversion: 2.1 time: 0.069651 Apr 14 00:26:30 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 64/845] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:26:30 2023] GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => generated 1212 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:26:32 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:32 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:32 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:32 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Creating event network-changed:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:26:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043599 Apr 14 00:26:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 395/846] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-plugged", "status": "completed", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Creating event network-vif-plugged:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:26:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Apr 14 00:26:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 388/847] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:37 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-plugged", "status": "completed", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:37 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Creating event network-vif-plugged:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:26:37 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042416 Apr 14 00:26:37 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 65/848] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] HTTP exception thrown: Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c could not be found. Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Request method failure captured: Apr 14 00:26:49 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c HTTP/1.1 Apr 14 00:26:49 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:26:49 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:26:49 user devstack@n-api.service[72774]: Connection: close Apr 14 00:26:49 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:26:49 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:26:49 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:26:49 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:26:49 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJnU9NoR16K4jD4Bh4PI7TXl-Wss5ITDouS9HFhRkZkEP6TA5ATNRb-lCaL6WqWoz32ly5ZoyLfoHcZi1_01Txos1P9o-ypWg3-KePDlInNnXk4z6Me7CNMVmwr0BIQrDnY1C11VQALNxSPTQ_soH50f30qTk_dF25qZIhQIj6TnwmI Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Project-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Tenant-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-User: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:26:49 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:26:49 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:26:49 user devstack@n-api.service[72774]: X-User-Id: f43f3171ccad4167ac783bbdfe2df478 Apr 14 00:26:49 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:26:49 user devstack@n-api.service[72774]: method: > Apr 14 00:26:49 user devstack@n-api.service[72774]: exception: Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c could not be found. Apr 14 00:26:49 user devstack@n-api.service[72774]: action_args: {'id': 'd1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c'} Apr 14 00:26:49 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c could not be found. Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c could not be found. Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c could not be found. Apr 14 00:26:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:26:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Returning 404 to user: Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:26:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-bcb20cc0-0254-400f-9adc-bd1c8daf0568 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" status: 404 len: 111 microversion: 2.1 time: 0.187697 Apr 14 00:26:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 396/849] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:26:49 2023] GET /compute/v2.1/servers/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:49 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:26:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 204 len: 0 microversion: 2.1 time: 0.118822 Apr 14 00:26:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 389/850] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:26:49 2023] DELETE /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:50 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:26:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-034ab460-782d-49dc-be8a-7e507b2e049f tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 200 len: 1510 microversion: 2.1 time: 0.198474 Apr 14 00:26:50 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 66/851] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:26:49 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:26:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-unplugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Creating event network-vif-unplugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:26:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077234 Apr 14 00:26:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 397/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:50 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-deleted", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:50 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] Creating event network-vif-deleted:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:26:50 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 Apr 14 00:26:50 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 390/853] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:26:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9", "name": "network-vif-plugged", "status": "completed", "tag": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:26:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:26:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:26:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:26:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Creating event network-vif-plugged:10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 on user Apr 14 00:26:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031569 Apr 14 00:26:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 67/854] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:27:00 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:00 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:01 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:27:01 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b3353670-50b3-4d6e-9541-fb6bd99f7c48 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1547 microversion: 2.1 time: 0.330133 Apr 14 00:27:01 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 398/855] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:27:00 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1547 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/action" status: 200 len: 28463 microversion: 2.1 time: 0.218123 Apr 14 00:27:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 391/856] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:27:01 2023] POST /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1/action => generated 28463 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:01 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:27:01 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-63615ba3-ae84-4ccb-b8a6-69caeb5edb87 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60" status: 200 len: 1540 microversion: 2.1 time: 0.138928 Apr 14 00:27:01 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 68/857] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:27:01 2023] GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 => generated 1540 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:20 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:27:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-420abb50-2743-42d1-89b7-e152ac14d591 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1" status: 200 len: 1495 microversion: 2.1 time: 0.270859 Apr 14 00:27:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 399/858] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:27:20 2023] GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => generated 1495 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] HTTP exception thrown: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 could not be found. Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Request method failure captured: Apr 14 00:27:40 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 HTTP/1.1 Apr 14 00:27:40 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:27:40 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:27:40 user devstack@n-api.service[72773]: Connection: close Apr 14 00:27:40 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:27:40 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:27:40 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:27:40 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:27:40 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJnU9NoR16K4jD4Bh4PI7TXl-Wss5ITDouS9HFhRkZkEP6TA5ATNRb-lCaL6WqWoz32ly5ZoyLfoHcZi1_01Txos1P9o-ypWg3-KePDlInNnXk4z6Me7CNMVmwr0BIQrDnY1C11VQALNxSPTQ_soH50f30qTk_dF25qZIhQIj6TnwmI Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Project-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/524265958bd24a6cb94aa3115eb2b6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Tenant-Id: 524265958bd24a6cb94aa3115eb2b6c7 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055458768 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-User: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:27:40 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:27:40 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:27:40 user devstack@n-api.service[72773]: X-User-Id: f43f3171ccad4167ac783bbdfe2df478 Apr 14 00:27:40 user devstack@n-api.service[72773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055458768-project-member Apr 14 00:27:40 user devstack@n-api.service[72773]: method: > Apr 14 00:27:40 user devstack@n-api.service[72773]: exception: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 could not be found. Apr 14 00:27:40 user devstack@n-api.service[72773]: action_args: {'id': '6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9'} Apr 14 00:27:40 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 could not be found. Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 could not be found. Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 could not be found. Apr 14 00:27:40 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:27:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Returning 404 to user: Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:27:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f7a7dbbe-3e74-4e73-b375-0a2ea9345f6b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" status: 404 len: 111 microversion: 2.1 time: 0.048827 Apr 14 00:27:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 392/859] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:27:40 2023] GET /compute/v2.1/servers/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=14 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1146244002", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "8b306bb0-c969-4918-a696-dd539eaa3a21"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] validate_networks() for [('8b306bb0-c969-4918-a696-dd539eaa3a21', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Getting quotas for project e46ba54fdcdb45368f457001f26a281b. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Getting quotas for user 67248d6b437547918b0cc2b0cdf29536 and project e46ba54fdcdb45368f457001f26a281b. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:27:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:27:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.679469 Apr 14 00:27:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 69/860] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:27:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:27:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-eb5c2ddc-c476-4adc-9300-f38bc8145b68 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:27:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-eb5c2ddc-c476-4adc-9300-f38bc8145b68 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:27:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:53 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-eb5c2ddc-c476-4adc-9300-f38bc8145b68 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:27:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-eb5c2ddc-c476-4adc-9300-f38bc8145b68 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1211 microversion: 2.1 time: 0.079001 Apr 14 00:27:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 400/861] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:27:53 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:27:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d04f694-0eba-46c3-a617-97d3de666de8", "tag": "e7556e77-8734-4ef9-b260-2503b06b73bc"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:27:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Creating event network-changed:e7556e77-8734-4ef9-b260-2503b06b73bc for instance 2d04f694-0eba-46c3-a617-97d3de666de8 on user Apr 14 00:27:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037822 Apr 14 00:27:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 393/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:27:57 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d04f694-0eba-46c3-a617-97d3de666de8", "name": "network-vif-plugged", "status": "completed", "tag": "e7556e77-8734-4ef9-b260-2503b06b73bc"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:27:57 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:57 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:57 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:57 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Creating event network-vif-plugged:e7556e77-8734-4ef9-b260-2503b06b73bc for instance 2d04f694-0eba-46c3-a617-97d3de666de8 on user Apr 14 00:27:57 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 Apr 14 00:27:57 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 70/863] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:27:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d04f694-0eba-46c3-a617-97d3de666de8", "name": "network-vif-plugged", "status": "completed", "tag": "e7556e77-8734-4ef9-b260-2503b06b73bc"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:27:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:27:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:27:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:27:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Creating event network-vif-plugged:e7556e77-8734-4ef9-b260-2503b06b73bc for instance 2d04f694-0eba-46c3-a617-97d3de666de8 on user Apr 14 00:27:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028239 Apr 14 00:27:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 401/864] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:27:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:28:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 204 len: 0 microversion: 2.1 time: 0.115800 Apr 14 00:28:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 394/865] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:28:01 2023] DELETE /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-unplugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:02 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:28:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-64cbb921-5797-489b-a52b-bd0b930341e8 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 200 len: 1553 microversion: 2.1 time: 0.234446 Apr 14 00:28:02 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 71/866] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:28:01 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:28:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Creating event network-vif-unplugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:28:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039114 Apr 14 00:28:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 402/867] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-deleted", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] Creating event network-vif-deleted:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:28:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Apr 14 00:28:04 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 395/868] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:04 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f2d364-908f-41c6-8e0c-df376a5d14f1", "name": "network-vif-plugged", "status": "completed", "tag": "db5a953b-fab8-4158-b9bb-95c4db32658e"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:04 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:04 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:04 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:04 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:04 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:04 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Creating event network-vif-plugged:db5a953b-fab8-4158-b9bb-95c4db32658e for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 on user Apr 14 00:28:04 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050406 Apr 14 00:28:04 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 72/869] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62c40b52-a5d3-47d1-8a30-d50aa4514387", "device": "/dev/vdb"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:20 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:20 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281445 Apr 14 00:28:20 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 403/870] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:28:20 2023] POST /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:42 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'services' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:28:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/os-volume_attachments/62c40b52-a5d3-47d1-8a30-d50aa4514387" status: 202 len: 0 microversion: 2.1 time: 0.244795 Apr 14 00:28:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 396/871] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:28:42 2023] DELETE /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/os-volume_attachments/62c40b52-a5d3-47d1-8a30-d50aa4514387 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=12 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:42 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Going to try to terminate instance {{(pid=72775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:28:42 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1" status: 204 len: 0 microversion: 2.1 time: 0.127371 Apr 14 00:28:42 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 73/872] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:28:42 2023] DELETE /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:42 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:28:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b19f23d3-3cb5-4772-9bea-be85e9731bcf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1" status: 200 len: 1547 microversion: 2.1 time: 0.174196 Apr 14 00:28:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 404/873] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:28:42 2023] GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:43 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:28:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b45b2d2c-c02e-4c5e-a754-2b741d5afb2e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1494 microversion: 2.1 time: 0.257088 Apr 14 00:28:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 397/874] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:28:43 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1494 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:28:44 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-unplugged", "status": "completed", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:44 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Creating event network-vif-unplugged:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:28:44 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034395 Apr 14 00:28:44 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 74/875] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-plugged", "status": "completed", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}, {"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-plugged", "status": "completed", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}, {"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-plugged", "status": "completed", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}, {"server_uuid": "a4235d23-9b0d-4da3-870c-778c6c9b7ae1", "name": "network-vif-deleted", "tag": "417e91ad-d81e-4837-ad20-0a9b57e85496"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Creating event network-vif-plugged:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:28:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Creating event network-vif-plugged:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:28:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Creating event network-vif-plugged:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:28:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Creating event network-vif-deleted:417e91ad-d81e-4837-ad20-0a9b57e85496 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 on user Apr 14 00:28:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.035155 Apr 14 00:28:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 405/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:28:52 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 HTTP/1.1 Apr 14 00:28:52 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:28:52 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:28:52 user devstack@n-api.service[72773]: Connection: close Apr 14 00:28:52 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:28:52 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:28:52 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:28:52 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:28:52 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:28:52 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72773]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:28:52 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:28:52 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:28:52 user devstack@n-api.service[72773]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:28:52 user devstack@n-api.service[72773]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:28:52 user devstack@n-api.service[72773]: method: > Apr 14 00:28:52 user devstack@n-api.service[72773]: exception: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72773]: action_args: {'id': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1'} Apr 14 00:28:52 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:28:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0829a39e-85fb-4d66-a959-c4b0c28cfac7 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 404 len: 111 microversion: 2.1 time: 0.029707 Apr 14 00:28:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 398/877] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:28:52 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:28:52 user devstack@n-api.service[72775]: request: DELETE /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 HTTP/1.1 Apr 14 00:28:52 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:28:52 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:28:52 user devstack@n-api.service[72775]: Connection: close Apr 14 00:28:52 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:28:52 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:28:52 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:28:52 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:28:52 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:28:52 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72775]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:28:52 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:28:52 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:28:52 user devstack@n-api.service[72775]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:28:52 user devstack@n-api.service[72775]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:28:52 user devstack@n-api.service[72775]: method: > Apr 14 00:28:52 user devstack@n-api.service[72775]: exception: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72775]: action_args: {'id': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1'} Apr 14 00:28:52 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:28:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-598d473a-4561-4dbe-bb70-df05dd8c1d30 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 404 len: 111 microversion: 2.1 time: 0.030194 Apr 14 00:28:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 75/878] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:28:52 2023] DELETE /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:28:52 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 HTTP/1.1 Apr 14 00:28:52 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:28:52 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:28:52 user devstack@n-api.service[72774]: Connection: close Apr 14 00:28:52 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:28:52 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:28:52 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:28:52 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:28:52 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:28:52 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:28:52 user devstack@n-api.service[72774]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:28:52 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:28:52 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:28:52 user devstack@n-api.service[72774]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:28:52 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:28:52 user devstack@n-api.service[72774]: method: > Apr 14 00:28:52 user devstack@n-api.service[72774]: exception: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72774]: action_args: {'id': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1'} Apr 14 00:28:52 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. Apr 14 00:28:52 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:28:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4bb50e40-bbf7-4820-ab5f-05e340b90842 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1" status: 404 len: 111 microversion: 2.1 time: 0.029265 Apr 14 00:28:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 406/879] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:28:52 2023] GET /compute/v2.1/servers/a1f2d364-908f-41c6-8e0c-df376a5d14f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:28:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60" status: 204 len: 0 microversion: 2.1 time: 0.116907 Apr 14 00:28:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 399/880] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:28:52 2023] DELETE /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "name": "network-vif-unplugged", "status": "completed", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Creating event network-vif-unplugged:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:28:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030755 Apr 14 00:28:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 407/881] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:52 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:28:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-7765507d-0513-4078-b0a1-b67b898131fb tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60" status: 200 len: 1546 microversion: 2.1 time: 0.459867 Apr 14 00:28:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 76/882] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:28:52 2023] GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 => generated 1546 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:28:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "name": "network-vif-deleted", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] Creating event network-vif-deleted:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:28:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034208 Apr 14 00:28:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 400/883] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:28:54 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785033c7-e14b-418e-952a-248328b75d60", "name": "network-vif-plugged", "status": "completed", "tag": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:28:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:28:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:28:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:28:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Creating event network-vif-plugged:29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance 785033c7-e14b-418e-952a-248328b75d60 on user Apr 14 00:28:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Apr 14 00:28:54 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 408/884] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:28:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:32 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] HTTP exception thrown: Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 could not be found. Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Request method failure captured: Apr 14 00:29:32 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1 HTTP/1.1 Apr 14 00:29:32 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:29:32 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:29:32 user devstack@n-api.service[72775]: Connection: close Apr 14 00:29:32 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:29:32 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:29:32 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:29:32 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:29:32 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJ2vo_PVdfyn146VB2PBOGcC8iM0D2ubTYAUzGvWc95ITsWCCSJVzUByHkwcW2-jr0lwt18DRflTPOBDdsv6Vq-nLA6eXliR0UZpek9szsxB2RO5Jp_jVnbi1AH8CSzbFJcpBgAeXz3WDknn8C0WH3wrJlnEZI22jenUiRQR2Nyfk7k Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Project-Id: 851640ccdac240bcb6b9b0a89dd250d8 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Project-Name: tempest-VolumesSnapshotTestJSON-655184435 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/851640ccdac240bcb6b9b0a89dd250d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/851640ccdac240bcb6b9b0a89dd250d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/851640ccdac240bcb6b9b0a89dd250d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Tenant: tempest-VolumesSnapshotTestJSON-655184435 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Tenant-Id: 851640ccdac240bcb6b9b0a89dd250d8 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-655184435 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-User: tempest-VolumesSnapshotTestJSON-655184435-project-member Apr 14 00:29:32 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:29:32 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:29:32 user devstack@n-api.service[72775]: X-User-Id: f922c56244e442028d3265b23a8fffd5 Apr 14 00:29:32 user devstack@n-api.service[72775]: X-User-Name: tempest-VolumesSnapshotTestJSON-655184435-project-member Apr 14 00:29:32 user devstack@n-api.service[72775]: method: > Apr 14 00:29:32 user devstack@n-api.service[72775]: exception: Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 could not be found. Apr 14 00:29:32 user devstack@n-api.service[72775]: action_args: {'id': 'a4235d23-9b0d-4da3-870c-778c6c9b7ae1'} Apr 14 00:29:32 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 could not be found. Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 could not be found. Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 could not be found. Apr 14 00:29:32 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:32 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Returning 404 to user: Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:29:32 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-276a05a2-29d3-4283-a7bf-1a0ce0e2c350 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1" status: 404 len: 111 microversion: 2.1 time: 0.048185 Apr 14 00:29:32 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 77/885] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:29:32 2023] GET /compute/v2.1/servers/a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance 785033c7-e14b-418e-952a-248328b75d60 could not be found. Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:29:43 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 HTTP/1.1 Apr 14 00:29:43 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:29:43 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:29:43 user devstack@n-api.service[72773]: Connection: close Apr 14 00:29:43 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:29:43 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:29:43 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:29:43 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:29:43 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:29:43 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:43 user devstack@n-api.service[72773]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:29:43 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:29:43 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:29:43 user devstack@n-api.service[72773]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:29:43 user devstack@n-api.service[72773]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:29:43 user devstack@n-api.service[72773]: method: > Apr 14 00:29:43 user devstack@n-api.service[72773]: exception: Instance 785033c7-e14b-418e-952a-248328b75d60 could not be found. Apr 14 00:29:43 user devstack@n-api.service[72773]: action_args: {'id': '785033c7-e14b-418e-952a-248328b75d60'} Apr 14 00:29:43 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785033c7-e14b-418e-952a-248328b75d60 could not be found. Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785033c7-e14b-418e-952a-248328b75d60 could not be found. Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785033c7-e14b-418e-952a-248328b75d60 could not be found. Apr 14 00:29:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance 785033c7-e14b-418e-952a-248328b75d60 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:29:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f418a4d1-2c57-4468-917e-6d2fb2f0a10f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60" status: 404 len: 111 microversion: 2.1 time: 0.038971 Apr 14 00:29:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 401/886] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:29:43 2023] GET /compute/v2.1/servers/785033c7-e14b-418e-952a-248328b75d60 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=10 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=14 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-869198220", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "83abe289-89d1-4c43-bfc5-19bcfdcc8309"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] validate_networks() for [('83abe289-89d1-4c43-bfc5-19bcfdcc8309', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-983427950", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "networks": [{"uuid": "8b306bb0-c969-4918-a696-dd539eaa3a21"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] validate_networks() for [('8b306bb0-c969-4918-a696-dd539eaa3a21', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting quotas for project 851640ccdac240bcb6b9b0a89dd250d8. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting quotas for user f922c56244e442028d3265b23a8fffd5 and project 851640ccdac240bcb6b9b0a89dd250d8. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:29:43 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:29:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.639820 Apr 14 00:29:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 409/887] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:29:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-02a6c5d9-c1fa-4bf4-98bc-8cc55fdcf18d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-02a6c5d9-c1fa-4bf4-98bc-8cc55fdcf18d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:29:43 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-02a6c5d9-c1fa-4bf4-98bc-8cc55fdcf18d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:29:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-02a6c5d9-c1fa-4bf4-98bc-8cc55fdcf18d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781" status: 200 len: 1212 microversion: 2.1 time: 0.072946 Apr 14 00:29:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 402/888] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:29:43 2023] GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781 => generated 1212 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Getting quotas for project e46ba54fdcdb45368f457001f26a281b. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Getting quotas for user 67248d6b437547918b0cc2b0cdf29536 and project e46ba54fdcdb45368f457001f26a281b. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:29:43 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:29:44 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.497944 Apr 14 00:29:44 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 78/889] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:29:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:29:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ed92f9d0-7d62-4d3f-8721-8bc916d9acf8 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:44 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ed92f9d0-7d62-4d3f-8721-8bc916d9acf8 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:29:44 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-ed92f9d0-7d62-4d3f-8721-8bc916d9acf8 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:29:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ed92f9d0-7d62-4d3f-8721-8bc916d9acf8 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 200 len: 1210 microversion: 2.1 time: 0.080780 Apr 14 00:29:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 410/890] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:29:44 2023] GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:29:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd24977-c1b5-4bc5-b651-d6061483e781", "tag": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Creating event network-changed:05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 on user Apr 14 00:29:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033553 Apr 14 00:29:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 403/891] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:29:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:49 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:29:49 user devstack@n-api.service[72775]: request: DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd HTTP/1.1 Apr 14 00:29:49 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:29:49 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:29:49 user devstack@n-api.service[72775]: Connection: close Apr 14 00:29:49 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:29:49 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:29:49 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:29:49 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:29:49 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:29:49 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:49 user devstack@n-api.service[72775]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:29:49 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:29:49 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:29:49 user devstack@n-api.service[72775]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:29:49 user devstack@n-api.service[72775]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:29:49 user devstack@n-api.service[72775]: method: > Apr 14 00:29:49 user devstack@n-api.service[72775]: exception: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72775]: action_args: {'id': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'} Apr 14 00:29:49 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:29:49 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f2a3991a-3619-4dfc-af2e-50a797307a45 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 404 len: 111 microversion: 2.1 time: 0.030088 Apr 14 00:29:49 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 79/892] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:29:49 2023] DELETE /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HTTP exception thrown: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Request method failure captured: Apr 14 00:29:49 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd HTTP/1.1 Apr 14 00:29:49 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:29:49 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:29:49 user devstack@n-api.service[72774]: Connection: close Apr 14 00:29:49 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:29:49 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:29:49 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:29:49 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:29:49 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJiodFNk8S-ApR3uW71hnaL9uxn-K-HSKn7KciCPFNuh1e_dQ9HG38LTYuhdnft5kMun-CyQ2U8aWzTkL-I6XVUMTnU9vq_uxqBjbgaU7l_urS2hiytZAdXLEiNaS6KXfuYpXPFHddNqPJSKi6v7MT1yoexT5IU0DyEwjSBKGIdgpxg Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Project-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf8663ccad9047f4b11b9ae0646c287a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Tenant: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Tenant-Id: bf8663ccad9047f4b11b9ae0646c287a Apr 14 00:29:49 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServerActionsTestJSON-948553482 Apr 14 00:29:49 user devstack@n-api.service[72774]: X-User: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:29:49 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:29:49 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:29:49 user devstack@n-api.service[72774]: X-User-Id: 3d86662f2c7648daad87118b7e9f757c Apr 14 00:29:49 user devstack@n-api.service[72774]: X-User-Name: tempest-ServerActionsTestJSON-948553482-project-member Apr 14 00:29:49 user devstack@n-api.service[72774]: method: > Apr 14 00:29:49 user devstack@n-api.service[72774]: exception: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72774]: action_args: {'id': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'} Apr 14 00:29:49 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. Apr 14 00:29:49 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:29:49 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Returning 404 to user: Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:29:49 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e380baa5-ab91-48bd-af48-25515bb3a9d4 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd" status: 404 len: 111 microversion: 2.1 time: 0.032761 Apr 14 00:29:49 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 411/893] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:29:49 2023] GET /compute/v2.1/servers/b3475e7e-ceb4-452a-a045-dbf43c5944dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:29:49 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1db5a67a-4d09-40a5-9ccd-7fcbf0e53aca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Calling method '.version_select at 0x7f3db69a23b0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:49 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1db5a67a-4d09-40a5-9ccd-7fcbf0e53aca tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040271550" status: 202 len: 0 microversion: 2.1 time: 0.080331 Apr 14 00:29:49 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 404/894] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 00:29:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040271550 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:29:50 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04d101a-2c7f-4c9d-81c8-0f2d866e1534", "tag": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Creating event network-changed:b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 on user Apr 14 00:29:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040916 Apr 14 00:29:50 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 80/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:29:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:29:51 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd24977-c1b5-4bc5-b651-d6061483e781", "name": "network-vif-plugged", "status": "completed", "tag": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:51 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Creating event network-vif-plugged:05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 on user Apr 14 00:29:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Apr 14 00:29:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 412/896] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd24977-c1b5-4bc5-b651-d6061483e781", "name": "network-vif-plugged", "status": "completed", "tag": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e"}, {"server_uuid": "c04d101a-2c7f-4c9d-81c8-0f2d866e1534", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5"}, {"server_uuid": "c04d101a-2c7f-4c9d-81c8-0f2d866e1534", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:29:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:29:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:29:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Creating event network-vif-plugged:05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 on user Apr 14 00:29:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Creating event network-vif-plugged:b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 on user Apr 14 00:29:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Creating event network-vif-plugged:b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 on user Apr 14 00:29:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.060504 Apr 14 00:29:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 405/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:55 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:55 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:55 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-c986f966-75c5-4bb5-a95d-2f1031040c41 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Action: 'create', calling method: .version_select at 0x7f3db6aa77f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-600047236", "metadata": {"Type": "work"}}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:29:55 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-c986f966-75c5-4bb5-a95d-2f1031040c41 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.615283 Apr 14 00:29:55 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 81/898] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 00:29:55 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 617 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 00:29:55 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:55 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-bb14f69c-1ed1-41cc-91c2-5fe05458c424 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db66bab90>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-bb14f69c-1ed1-41cc-91c2-5fe05458c424 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 200 len: 352 microversion: 2.1 time: 0.062729 Apr 14 00:29:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 413/899] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:29:55 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:56 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-14f9f5d0-2412-42c1-9f7b-9818b4315ad4 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db6c72dd0>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-14f9f5d0-2412-42c1-9f7b-9818b4315ad4 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 200 len: 353 microversion: 2.1 time: 0.062105 Apr 14 00:29:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 406/900] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:29:56 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:56 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-b16f2183-7179-4dc8-ba0d-c5cfd3be255c tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db69389d0>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:56 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-b16f2183-7179-4dc8-ba0d-c5cfd3be255c tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 200 len: 353 microversion: 2.1 time: 0.051929 Apr 14 00:29:56 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 82/901] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:29:56 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a0e4305f-915d-4f15-b104-9d67ce655f88 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db66b9cf0>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a0e4305f-915d-4f15-b104-9d67ce655f88 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 202 len: 0 microversion: 2.1 time: 0.070589 Apr 14 00:29:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 414/902] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 00:29:56 2023] DELETE /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:29:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0abe33f0-6d47-40d2-8617-ef339e3002db tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db69a3370>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0abe33f0-6d47-40d2-8617-ef339e3002db tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 200 len: 352 microversion: 2.1 time: 0.075735 Apr 14 00:29:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 407/903] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:29:56 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:58 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-74274ea6-9d06-4857-adc8-eb288179b4ef tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db6938670>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:58 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-74274ea6-9d06-4857-adc8-eb288179b4ef tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 200 len: 352 microversion: 2.1 time: 0.057680 Apr 14 00:29:58 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 83/904] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:29:58 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:29:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-92686b67-7079-40aa-a7bd-6a4bd25429e2 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db6b39000>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:29:59 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-92686b67-7079-40aa-a7bd-6a4bd25429e2 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 200 len: 352 microversion: 2.1 time: 0.055149 Apr 14 00:29:59 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 415/905] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:29:59 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:30:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a6df6755-9c32-460d-8ab7-cd8f336b2d06 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Calling method '.version_select at 0x7f3db69a3370>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:30:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-a6df6755-9c32-460d-8ab7-cd8f336b2d06 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] HTTP exception thrown: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. Apr 14 00:30:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a6df6755-9c32-460d-8ab7-cd8f336b2d06 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Request method failure captured: Apr 14 00:30:00 user devstack@n-api.service[72773]: request: GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 HTTP/1.1 Apr 14 00:30:00 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:30:00 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:30:00 user devstack@n-api.service[72773]: Connection: close Apr 14 00:30:00 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:30:00 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:30:00 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:30:00 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:30:00 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ6C_AgZGmTajREhns2WjtOVGp1f1lZ6HIiQ__ujft-qmdB3mrUn4nUUn1u0exQ1MTj99qNU2DkqEtDGYypiMGZCbBr0dWU0ai89FD_fH1SblvNzjeFTbB3dewE9YuMSHUWjCk6EqUQEzMJJeyPh-4wn9fZr0M8CSVvM95ZpCD_1GJU Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Project-Id: 532754441b5b4e29b19b4b877208674f Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesGetTestJSON-1055780600 Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/532754441b5b4e29b19b4b877208674f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/532754441b5b4e29b19b4b877208674f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/532754441b5b4e29b19b4b877208674f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesGetTestJSON-1055780600 Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Tenant-Id: 532754441b5b4e29b19b4b877208674f Apr 14 00:30:00 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesGetTestJSON-1055780600 Apr 14 00:30:00 user devstack@n-api.service[72773]: X-User: tempest-VolumesGetTestJSON-1055780600-project-member Apr 14 00:30:00 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:30:00 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:30:00 user devstack@n-api.service[72773]: X-User-Id: b908cd904b7f4f298cc4c8f1afe0b454 Apr 14 00:30:00 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesGetTestJSON-1055780600-project-member Apr 14 00:30:00 user devstack@n-api.service[72773]: method: Apr 14 00:30:00 user devstack@n-api.service[72773]: exception: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. Apr 14 00:30:00 user devstack@n-api.service[72773]: action_args: {'id': 'e6d8bdbf-1181-4c21-b159-ed5bdcf94d28'} Apr 14 00:30:00 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. (HTTP 404) (Request-ID: req-8b2d4bc2-827a-4412-9a93-5e6f6858b596) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. Apr 14 00:30:00 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:30:00 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a6df6755-9c32-460d-8ab7-cd8f336b2d06 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] Returning 404 to user: Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:30:00 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a6df6755-9c32-460d-8ab7-cd8f336b2d06 tempest-VolumesGetTestJSON-1055780600 tempest-VolumesGetTestJSON-1055780600-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28" status: 404 len: 109 microversion: 2.1 time: 0.035452 Apr 14 00:30:00 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 408/906] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 00:30:00 2023] GET /compute/v2.1/os-volumes/e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:34 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:30:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-723c4a8a-a372-4d12-bbbd-3d802b353eef tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781" status: 200 len: 1495 microversion: 2.1 time: 0.193535 Apr 14 00:30:34 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 84/907] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:30:33 2023] GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781 => generated 1495 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:34 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:30:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-17ef0eea-296b-4dca-8dca-84d06da52044 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 200 len: 1493 microversion: 2.1 time: 0.181425 Apr 14 00:30:34 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 416/908] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:30:34 2023] GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 1493 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:30:47 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:47 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1de894a6-fae2-4bd3-af3c-a1a8fe37d541 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'create', calling method: .version_select at 0x7f3db6933490>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1820486155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:30:47 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-1de894a6-fae2-4bd3-af3c-a1a8fe37d541 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for project 46777f523af54eecb0e3260f14df7909. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:30:47 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-1de894a6-fae2-4bd3-af3c-a1a8fe37d541 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for user e5ad76f13b78448887913c4d0bcb16af and project 46777f523af54eecb0e3260f14df7909. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:30:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1de894a6-fae2-4bd3-af3c-a1a8fe37d541 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055001 Apr 14 00:30:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 409/909] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:30:47 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-135186904", "imageRef": "69b3b215-794a-4b99-9d8b-56aa656eaf64", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1820486155", "networks": [{"uuid": "d7b8d180-999a-4f41-b677-e83b1c24a8a9"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] validate_networks() for [('d7b8d180-999a-4f41-b677-e83b1c24a8a9', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for project 46777f523af54eecb0e3260f14df7909. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for user e5ad76f13b78448887913c4d0bcb16af and project 46777f523af54eecb0e3260f14df7909. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:30:47 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69b3b215-794a-4b99-9d8b-56aa656eaf64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:30:47 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.513362 Apr 14 00:30:47 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 85/910] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:30:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:30:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-6943e9b1-803c-46f8-8a0e-ef9dcb699f73 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:30:47 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-6943e9b1-803c-46f8-8a0e-ef9dcb699f73 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:30:47 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:47 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:47 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-6943e9b1-803c-46f8-8a0e-ef9dcb699f73 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:30:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-6943e9b1-803c-46f8-8a0e-ef9dcb699f73 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1252 microversion: 2.1 time: 0.082600 Apr 14 00:30:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 417/911] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:30:47 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1252 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:30:51 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:30:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:51 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Creating event network-changed:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:30:51 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032330 Apr 14 00:30:51 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 410/912] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:30:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:30:53 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-plugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:30:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:53 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Creating event network-vif-plugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:30:53 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112336 Apr 14 00:30:53 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 86/913] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:30:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:30:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-plugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:30:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:30:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:30:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:30:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Creating event network-vif-plugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:30:55 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029644 Apr 14 00:30:55 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 418/914] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:30:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "282895bf-6b53-4106-a1e2-abc962b1c521", "device": "/dev/vdb"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Going to try to terminate instance {{(pid=72775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:31:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 204 len: 0 microversion: 2.1 time: 0.124279 Apr 14 00:31:34 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 87/915] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:31:34 2023] DELETE /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556093 Apr 14 00:31:34 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 411/916] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:31:34 2023] POST /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:31:34 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:31:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5a04c1ff-a23a-4059-863c-a235c7b0b06c tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 200 len: 1499 microversion: 2.1 time: 0.232757 Apr 14 00:31:34 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 419/917] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:31:34 2023] GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04d101a-2c7f-4c9d-81c8-0f2d866e1534", "name": "network-vif-unplugged", "status": "completed", "tag": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Creating event network-vif-unplugged:b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 on user Apr 14 00:31:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032502 Apr 14 00:31:34 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 88/918] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:31:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:31:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04d101a-2c7f-4c9d-81c8-0f2d866e1534", "name": "network-vif-deleted", "tag": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] Creating event network-vif-deleted:b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 on user Apr 14 00:31:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088292 Apr 14 00:31:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 412/919] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:31:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04d101a-2c7f-4c9d-81c8-0f2d866e1534", "name": "network-vif-plugged", "status": "completed", "tag": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Creating event network-vif-plugged:b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 on user Apr 14 00:31:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031887 Apr 14 00:31:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 420/920] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:38 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:31:38 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-0a85dd20-c0a9-4a10-87ca-b0c0869f7f47 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1537 microversion: 2.1 time: 0.239509 Apr 14 00:31:38 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 89/921] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:31:38 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:53 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'services' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:31:53 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781/os-volume_attachments/282895bf-6b53-4106-a1e2-abc962b1c521" status: 202 len: 0 microversion: 2.1 time: 0.186217 Apr 14 00:31:53 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 413/922] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:31:53 2023] DELETE /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781/os-volume_attachments/282895bf-6b53-4106-a1e2-abc962b1c521 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:31:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781" status: 204 len: 0 microversion: 2.1 time: 0.122432 Apr 14 00:31:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 421/923] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:31:53 2023] DELETE /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:53 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:31:53 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-fc4512b5-e585-4580-9c2f-df5cc948fd51 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781" status: 200 len: 1547 microversion: 2.1 time: 0.154131 Apr 14 00:31:53 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 90/924] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:31:53 2023] GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:31:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd24977-c1b5-4bc5-b651-d6061483e781", "name": "network-vif-unplugged", "status": "completed", "tag": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Creating event network-vif-unplugged:05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 on user Apr 14 00:31:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079801 Apr 14 00:31:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 414/925] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:31:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd24977-c1b5-4bc5-b651-d6061483e781", "name": "network-vif-deleted", "tag": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] Creating event network-vif-deleted:05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 on user Apr 14 00:31:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027328 Apr 14 00:31:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 422/926] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:31:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:31:57 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd24977-c1b5-4bc5-b651-d6061483e781", "name": "network-vif-plugged", "status": "completed", "tag": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:31:57 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:31:57 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:31:57 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:31:57 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Creating event network-vif-plugged:05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 on user Apr 14 00:31:57 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028330 Apr 14 00:31:57 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 91/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] HTTP exception thrown: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Request method failure captured: Apr 14 00:32:24 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 HTTP/1.1 Apr 14 00:32:24 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:32:24 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:32:24 user devstack@n-api.service[72773]: Connection: close Apr 14 00:32:24 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:32:24 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:32:24 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:32:24 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:32:24 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ4IjjObSgxtPkVvvCFlOP5weVu6bpKkfkGZ7pBH9H5TISr7dhQ70Zm29HPT0u0M2Kf0CbS0imgCI9ZJWNLp3QbPYhXsdOpdvm_47Z1gaVeoy7AwV9neuVpseu59qFdDMojehiQ2W3-ysQjt2l3TpFT52QP3pYr34cFbmqrMPmVIL1Y Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Project-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Tenant: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Tenant-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:32:24 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:32:24 user devstack@n-api.service[72773]: X-User: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:32:24 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:32:24 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:32:24 user devstack@n-api.service[72773]: X-User-Id: 67248d6b437547918b0cc2b0cdf29536 Apr 14 00:32:24 user devstack@n-api.service[72773]: X-User-Name: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:32:24 user devstack@n-api.service[72773]: method: > Apr 14 00:32:24 user devstack@n-api.service[72773]: exception: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:32:24 user devstack@n-api.service[72773]: action_args: {'id': 'c04d101a-2c7f-4c9d-81c8-0f2d866e1534'} Apr 14 00:32:24 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:32:24 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:24 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Returning 404 to user: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:32:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bfd222a3-fe11-4ca8-9085-47d59b22d46e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 404 len: 111 microversion: 2.1 time: 0.042585 Apr 14 00:32:24 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 415/928] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:24 2023] GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:24 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:25 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:32:25 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-ec701224-838d-4a06-9d43-df40e403c5b2 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1494 microversion: 2.1 time: 0.316947 Apr 14 00:32:25 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 423/929] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:24 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1494 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:38 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:32:38 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-5bb63030-3cc3-44df-aa7c-f759a9273b87 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1537 microversion: 2.1 time: 0.140189 Apr 14 00:32:38 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 92/930] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:38 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1537 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Searching by: {'deleted': False, 'project_id': '46777f523af54eecb0e3260f14df7909'} {{(pid=72773) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:38 user devstack@n-api.service[72773]: DEBUG nova.compute.multi_cell_list [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72773) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 00:32:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2a98478f-d49a-48e4-8ae6-51170b262671 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.224684 Apr 14 00:32:38 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 416/931] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 00:32:38 2023] GET /compute/v2.1/servers => generated 340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:38 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:32:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-be21f316-b1da-452d-bfee-3e41a76731de tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1537 microversion: 2.1 time: 0.144959 Apr 14 00:32:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 424/932] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:38 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f9e1f92-e142-4576-a375-32dc12d96c82"}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:40 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:40 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289670 Apr 14 00:32:40 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 93/933] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:32:40 2023] POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] HTTP exception thrown: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Request method failure captured: Apr 14 00:32:43 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781 HTTP/1.1 Apr 14 00:32:43 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:32:43 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:32:43 user devstack@n-api.service[72773]: Connection: close Apr 14 00:32:43 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:32:43 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:32:43 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:32:43 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:32:43 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ2vo_PVdfyn146VB2PBOGcC8iM0D2ubTYAUzGvWc95ITsWCCSJVzUByHkwcW2-jr0lwt18DRflTPOBDdsv6Vq-nLA6eXliR0UZpek9szsxB2RO5Jp_jVnbi1AH8CSzbFJcpBgAeXz3WDknn8C0WH3wrJlnEZI22jenUiRQR2Nyfk7k Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Project-Id: 851640ccdac240bcb6b9b0a89dd250d8 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Project-Name: tempest-VolumesSnapshotTestJSON-655184435 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/851640ccdac240bcb6b9b0a89dd250d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/851640ccdac240bcb6b9b0a89dd250d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/851640ccdac240bcb6b9b0a89dd250d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Tenant: tempest-VolumesSnapshotTestJSON-655184435 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Tenant-Id: 851640ccdac240bcb6b9b0a89dd250d8 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-655184435 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-User: tempest-VolumesSnapshotTestJSON-655184435-project-member Apr 14 00:32:43 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:32:43 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:32:43 user devstack@n-api.service[72773]: X-User-Id: f922c56244e442028d3265b23a8fffd5 Apr 14 00:32:43 user devstack@n-api.service[72773]: X-User-Name: tempest-VolumesSnapshotTestJSON-655184435-project-member Apr 14 00:32:43 user devstack@n-api.service[72773]: method: > Apr 14 00:32:43 user devstack@n-api.service[72773]: exception: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. Apr 14 00:32:43 user devstack@n-api.service[72773]: action_args: {'id': '5bd24977-c1b5-4bc5-b651-d6061483e781'} Apr 14 00:32:43 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. Apr 14 00:32:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:32:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Returning 404 to user: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:32:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e6ca3f68-046f-478c-bc1e-f23e8a49548c tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781" status: 404 len: 111 microversion: 2.1 time: 0.041201 Apr 14 00:32:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 417/934] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:43 2023] GET /compute/v2.1/servers/5bd24977-c1b5-4bc5-b651-d6061483e781 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:52 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:32:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-d13f4107-f32e-4301-ae6c-ecf0fb07aba9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1583 microversion: 2.1 time: 0.164909 Apr 14 00:32:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 425/935] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:52 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1583 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:32:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:32:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Creating event network-changed:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:32:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Apr 14 00:32:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 94/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:32:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1095885518"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:55 user devstack@n-api.service[72773]: INFO nova.network.security_group_api [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Adding security group 5eca6830-8860-4700-bb0f-9a76fa2ce0c5 to port bf80bc9c-a453-4809-8eb4-e57fe015351f Apr 14 00:32:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-cdf31279-6ed2-4416-82e9-7132a1411f7c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/action" status: 202 len: 0 microversion: 2.1 time: 0.552799 Apr 14 00:32:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 418/937] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:32:55 2023] POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:56 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:32:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5b0b8cb6-56df-46d1-9b77-7e080f8a8441 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1749 microversion: 2.1 time: 0.166461 Apr 14 00:32:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 426/938] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:56 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:32:56 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:32:56 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:56 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:56 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:56 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Creating event network-changed:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:32:56 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036736 Apr 14 00:32:56 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 95/939] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:32:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:59 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:59 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/action" status: 202 len: 0 microversion: 2.1 time: 0.098122 Apr 14 00:32:59 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 419/940] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:32:59 2023] POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:32:59 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:00 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:33:00 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-03d960ee-b9bb-424e-8378-f4491fed6f79 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1751 microversion: 2.1 time: 0.356632 Apr 14 00:33:00 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 427/941] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:32:59 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1751 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:33:00 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-unplugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:33:00 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:00 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:00 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:00 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Creating event network-vif-unplugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:33:00 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033521 Apr 14 00:33:00 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 96/942] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:33:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:33:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-plugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:33:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:03 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Creating event network-vif-plugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:33:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032693 Apr 14 00:33:03 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 420/943] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:33:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-plugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:33:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Creating event network-vif-plugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:33:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045596 Apr 14 00:33:05 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 428/944] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:33:07 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-plugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:33:07 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:07 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:07 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:07 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Creating event network-vif-plugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:33:07 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037859 Apr 14 00:33:07 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 97/945] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:33:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:33:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cf8cf474-419e-40a6-ab0b-d6e52685667e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1829342093", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6233bd0f-d400-4c8d-9aad-e052a2ae8f21", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8b306bb0-c969-4918-a696-dd539eaa3a21"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:33:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-cf8cf474-419e-40a6-ab0b-d6e52685667e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] HTTP exception thrown: Block Device 6233bd0f-d400-4c8d-9aad-e052a2ae8f21 is not bootable. Apr 14 00:33:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cf8cf474-419e-40a6-ab0b-d6e52685667e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Request method failure captured: Apr 14 00:33:28 user devstack@n-api.service[72773]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 00:33:28 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:33:28 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:33:28 user devstack@n-api.service[72773]: Connection: close Apr 14 00:33:28 user devstack@n-api.service[72773]: Content-Length: 357 Apr 14 00:33:28 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:33:28 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:33:28 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:33:28 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ4IjjObSgxtPkVvvCFlOP5weVu6bpKkfkGZ7pBH9H5TISr7dhQ70Zm29HPT0u0M2Kf0CbS0imgCI9ZJWNLp3QbPYhXsdOpdvm_47Z1gaVeoy7AwV9neuVpseu59qFdDMojehiQ2W3-ysQjt2l3TpFT52QP3pYr34cFbmqrMPmVIL1Y Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Project-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Tenant: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Tenant-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:33:28 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:33:28 user devstack@n-api.service[72773]: X-User: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:33:28 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:33:28 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:33:28 user devstack@n-api.service[72773]: X-User-Id: 67248d6b437547918b0cc2b0cdf29536 Apr 14 00:33:28 user devstack@n-api.service[72773]: X-User-Name: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:33:28 user devstack@n-api.service[72773]: Apr 14 00:33:28 user devstack@n-api.service[72773]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1829342093", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6233bd0f-d400-4c8d-9aad-e052a2ae8f21", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8b306bb0-c969-4918-a696-dd539eaa3a21"}]}} Apr 14 00:33:28 user devstack@n-api.service[72773]: method: > Apr 14 00:33:28 user devstack@n-api.service[72773]: exception: Block Device 6233bd0f-d400-4c8d-9aad-e052a2ae8f21 is not bootable. Apr 14 00:33:28 user devstack@n-api.service[72773]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1829342093', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6233bd0f-d400-4c8d-9aad-e052a2ae8f21'}], 'networks': [{'uuid': '8b306bb0-c969-4918-a696-dd539eaa3a21'}]}}} Apr 14 00:33:28 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6233bd0f-d400-4c8d-9aad-e052a2ae8f21 is not bootable. Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6233bd0f-d400-4c8d-9aad-e052a2ae8f21 is not bootable. Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6233bd0f-d400-4c8d-9aad-e052a2ae8f21 is not bootable. Apr 14 00:33:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:33:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-cf8cf474-419e-40a6-ab0b-d6e52685667e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Returning 400 to user: Block Device 6233bd0f-d400-4c8d-9aad-e052a2ae8f21 is not bootable. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:33:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-cf8cf474-419e-40a6-ab0b-d6e52685667e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.091232 Apr 14 00:33:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 421/946] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:33:27 2023] POST /compute/v2.1/servers => generated 110 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=20 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:28 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:33:28 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a89e498c-0b1a-4d26-b26a-8dc0298b25ca tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1494 microversion: 2.1 time: 0.153605 Apr 14 00:33:28 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 429/947] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:33:28 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1494 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:33:50 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:33:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-22dd2280-b645-4f21-a62c-1a6465beba8a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1749 microversion: 2.1 time: 0.180224 Apr 14 00:33:50 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 98/948] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:33:50 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:34:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-67b900f8-2364-49e8-bca0-a1bf496bae3b tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1494 microversion: 2.1 time: 0.160350 Apr 14 00:34:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 422/949] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:34:28 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1494 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1095885518"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:50 user devstack@n-api.service[72774]: INFO nova.network.security_group_api [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Removing security group 5eca6830-8860-4700-bb0f-9a76fa2ce0c5 from port bf80bc9c-a453-4809-8eb4-e57fe015351f Apr 14 00:34:51 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-e60ed87d-f5dc-4557-b89b-e20d6e0a4624 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/action" status: 202 len: 0 microversion: 2.1 time: 0.557432 Apr 14 00:34:51 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 430/950] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:34:50 2023] POST /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 00:34:51 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:51 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:51 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:34:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:51 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:51 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Creating event network-changed:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:34:51 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040980 Apr 14 00:34:51 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 99/951] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:34:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:34:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:34:52 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:52 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Creating event network-changed:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:34:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032483 Apr 14 00:34:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 423/952] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:52 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'services' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:34:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments/0f9e1f92-e142-4576-a375-32dc12d96c82" status: 202 len: 0 microversion: 2.1 time: 0.165285 Apr 14 00:34:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 431/953] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:34:52 2023] DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments/0f9e1f92-e142-4576-a375-32dc12d96c82 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:34:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:34:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-cba93835-9b7b-4490-8ed0-ae49e9ef7cf7 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049767 Apr 14 00:34:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 100/954] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:34:52 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:35:31 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:31 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a51a76c-67d4-48e0-8856-2799a95ebf96 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1596333222", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6db62068-7278-4cd8-b41f-d0140d89e199", "destination_type": "local"}, {"source_type": "volume", "uuid": "b948765c-2d46-4af5-a2ba-3ece06ba2d2a", "destination_type": "invalid"}], "networks": [{"uuid": "8b306bb0-c969-4918-a696-dd539eaa3a21"}]}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:35:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a51a76c-67d4-48e0-8856-2799a95ebf96 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Request method failure captured: Apr 14 00:35:31 user devstack@n-api.service[72773]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 00:35:31 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:35:31 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:35:31 user devstack@n-api.service[72773]: Connection: close Apr 14 00:35:31 user devstack@n-api.service[72773]: Content-Length: 494 Apr 14 00:35:31 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:35:31 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:35:31 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:35:31 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ4IjjObSgxtPkVvvCFlOP5weVu6bpKkfkGZ7pBH9H5TISr7dhQ70Zm29HPT0u0M2Kf0CbS0imgCI9ZJWNLp3QbPYhXsdOpdvm_47Z1gaVeoy7AwV9neuVpseu59qFdDMojehiQ2W3-ysQjt2l3TpFT52QP3pYr34cFbmqrMPmVIL1Y Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Project-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Tenant: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Tenant-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:35:31 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:35:31 user devstack@n-api.service[72773]: X-User: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:35:31 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:35:31 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:35:31 user devstack@n-api.service[72773]: X-User-Id: 67248d6b437547918b0cc2b0cdf29536 Apr 14 00:35:31 user devstack@n-api.service[72773]: X-User-Name: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:35:31 user devstack@n-api.service[72773]: Apr 14 00:35:31 user devstack@n-api.service[72773]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1596333222", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6db62068-7278-4cd8-b41f-d0140d89e199", "destination_type": "local"}, {"source_type": "volume", "uuid": "b948765c-2d46-4af5-a2ba-3ece06ba2d2a", "destination_type": "invalid"}], "networks": [{"uuid": "8b306bb0-c969-4918-a696-dd539eaa3a21"}]}} Apr 14 00:35:31 user devstack@n-api.service[72773]: method: > Apr 14 00:35:31 user devstack@n-api.service[72773]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 00:35:31 user devstack@n-api.service[72773]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1596333222', 'imageRef': '6db62068-7278-4cd8-b41f-d0140d89e199', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '6db62068-7278-4cd8-b41f-d0140d89e199', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '8b306bb0-c969-4918-a696-dd539eaa3a21'}]}}} Apr 14 00:35:31 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise error Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 00:35:31 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8a51a76c-67d4-48e0-8856-2799a95ebf96 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:35:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8a51a76c-67d4-48e0-8856-2799a95ebf96 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014164 Apr 14 00:35:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 424/955] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:35:31 2023] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:31 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:35:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-537c0ebb-bc9c-4c65-97b9-90a640992372 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1494 microversion: 2.1 time: 0.161292 Apr 14 00:35:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 432/956] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:35:31 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:42 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:42 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-1714f7e9-3f40-4311-a968-0af6197deb94 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053558 Apr 14 00:35:42 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 101/957] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:35:42 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HTTP exception thrown: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 is not attached to volume 0f9e1f92-e142-4576-a375-32dc12d96c82 Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Request method failure captured: Apr 14 00:35:42 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments/0f9e1f92-e142-4576-a375-32dc12d96c82 HTTP/1.1 Apr 14 00:35:42 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:35:42 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:35:42 user devstack@n-api.service[72773]: Connection: close Apr 14 00:35:42 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:35:42 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:35:42 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:35:42 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:35:42 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ6uESs8WWwxPkuZDTFk9MV25kZEbY8kSRpZTtplsN5je1j_FODBVcgZNdtHU1YDq027aVuJ8t8Q8xRi1somj6iHqzB3FEQEYZScaB1A86GaIV4hzu1Fcc8VFgmJ5v1j63D0_DVk5VbILA6MnZy12_rHyLtSe8T0iklcGW57fCmFCy0 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Project-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Project-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46777f523af54eecb0e3260f14df7909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Tenant: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Tenant-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:35:42 user devstack@n-api.service[72773]: X-User: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:35:42 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:35:42 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:35:42 user devstack@n-api.service[72773]: X-User-Id: e5ad76f13b78448887913c4d0bcb16af Apr 14 00:35:42 user devstack@n-api.service[72773]: X-User-Name: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:35:42 user devstack@n-api.service[72773]: method: > Apr 14 00:35:42 user devstack@n-api.service[72773]: exception: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 is not attached to volume 0f9e1f92-e142-4576-a375-32dc12d96c82 Apr 14 00:35:42 user devstack@n-api.service[72773]: action_args: {'server_id': '61d1abb2-3c80-48de-a26b-1c8030081105', 'id': '0f9e1f92-e142-4576-a375-32dc12d96c82'} Apr 14 00:35:42 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0f9e1f92-e142-4576-a375-32dc12d96c82. Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 is not attached to volume 0f9e1f92-e142-4576-a375-32dc12d96c82 Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 is not attached to volume 0f9e1f92-e142-4576-a375-32dc12d96c82 Apr 14 00:35:42 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:35:42 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Returning 404 to user: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 is not attached to volume 0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:35:42 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-80c47bf8-404a-4bc8-8d80-cda084ae9c18 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments/0f9e1f92-e142-4576-a375-32dc12d96c82" status: 404 len: 154 microversion: 2.1 time: 0.094544 Apr 14 00:35:42 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 425/958] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:35:42 2023] DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105/os-volume_attachments/0f9e1f92-e142-4576-a375-32dc12d96c82 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:47 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:35:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 204 len: 0 microversion: 2.1 time: 0.148592 Apr 14 00:35:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 433/959] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:35:47 2023] DELETE /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:47 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:35:47 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-5403583e-6e40-49cb-81bb-17dccebcd646 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 200 len: 1543 microversion: 2.1 time: 0.437540 Apr 14 00:35:47 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 102/960] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:35:47 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 1543 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:35:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-unplugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:35:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Creating event network-vif-unplugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:35:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028410 Apr 14 00:35:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 426/961] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:35:48 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-deleted", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:35:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:48 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] Creating event network-vif-deleted:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:35:48 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Apr 14 00:35:48 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 434/962] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:35:50 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1abb2-3c80-48de-a26b-1c8030081105", "name": "network-vif-plugged", "status": "completed", "tag": "bf80bc9c-a453-4809-8eb4-e57fe015351f"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:35:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:35:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:35:50 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:35:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Creating event network-vif-plugged:bf80bc9c-a453-4809-8eb4-e57fe015351f for instance 61d1abb2-3c80-48de-a26b-1c8030081105 on user Apr 14 00:35:50 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029553 Apr 14 00:35:50 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 103/963] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:35:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] HTTP exception thrown: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Request method failure captured: Apr 14 00:36:36 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 HTTP/1.1 Apr 14 00:36:36 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:36:36 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:36:36 user devstack@n-api.service[72773]: Connection: close Apr 14 00:36:36 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:36:36 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:36:36 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:36:36 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:36:36 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ4IjjObSgxtPkVvvCFlOP5weVu6bpKkfkGZ7pBH9H5TISr7dhQ70Zm29HPT0u0M2Kf0CbS0imgCI9ZJWNLp3QbPYhXsdOpdvm_47Z1gaVeoy7AwV9neuVpseu59qFdDMojehiQ2W3-ysQjt2l3TpFT52QP3pYr34cFbmqrMPmVIL1Y Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Project-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Tenant: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Tenant-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:36:36 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:36:36 user devstack@n-api.service[72773]: X-User: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:36:36 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:36:36 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:36:36 user devstack@n-api.service[72773]: X-User-Id: 67248d6b437547918b0cc2b0cdf29536 Apr 14 00:36:36 user devstack@n-api.service[72773]: X-User-Name: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:36:36 user devstack@n-api.service[72773]: method: > Apr 14 00:36:36 user devstack@n-api.service[72773]: exception: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72773]: action_args: {'id': 'c04d101a-2c7f-4c9d-81c8-0f2d866e1534'} Apr 14 00:36:36 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Returning 404 to user: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:36:36 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e8cce126-f1c6-4403-9464-646a7e4d3aff tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 404 len: 111 microversion: 2.1 time: 0.039260 Apr 14 00:36:36 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 427/964] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:36:36 2023] DELETE /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:36:36 user devstack@n-api.service[72774]: Fri Apr 14 00:36:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 (ip 10.0.0.210) !!! Apr 14 00:36:36 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:36:36 user devstack@n-api.service[72774]: Fri Apr 14 00:36:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 (ip 10.0.0.210) !!! Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] HTTP exception thrown: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Request method failure captured: Apr 14 00:36:36 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 HTTP/1.1 Apr 14 00:36:36 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:36:36 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:36:36 user devstack@n-api.service[72774]: Connection: close Apr 14 00:36:36 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:36:36 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:36:36 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:36:36 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:36:36 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOJ4IjjObSgxtPkVvvCFlOP5weVu6bpKkfkGZ7pBH9H5TISr7dhQ70Zm29HPT0u0M2Kf0CbS0imgCI9ZJWNLp3QbPYhXsdOpdvm_47Z1gaVeoy7AwV9neuVpseu59qFdDMojehiQ2W3-ysQjt2l3TpFT52QP3pYr34cFbmqrMPmVIL1Y Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Project-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Project-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Tenant: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Tenant-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:36:36 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:36:36 user devstack@n-api.service[72774]: X-User: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:36:36 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:36:36 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:36:36 user devstack@n-api.service[72774]: X-User-Id: 67248d6b437547918b0cc2b0cdf29536 Apr 14 00:36:36 user devstack@n-api.service[72774]: X-User-Name: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:36:36 user devstack@n-api.service[72774]: method: > Apr 14 00:36:36 user devstack@n-api.service[72774]: exception: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72774]: action_args: {'id': 'c04d101a-2c7f-4c9d-81c8-0f2d866e1534'} Apr 14 00:36:36 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. Apr 14 00:36:36 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:36:36 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Returning 404 to user: Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:36:36 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-2f92d1c2-e0c3-415a-bd5a-54682d952d0f tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534" status: 404 len: 111 microversion: 2.1 time: 0.046607 Apr 14 00:36:36 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 435/965] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:36:36 2023] GET /compute/v2.1/servers/c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:36:36 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:36:36 user devstack@n-api.service[72775]: Fri Apr 14 00:36:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 (ip 10.0.0.210) !!! Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=14 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:36 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Going to try to terminate instance {{(pid=72775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:36:37 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 204 len: 0 microversion: 2.1 time: 0.121914 Apr 14 00:36:37 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 104/966] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:36:36 2023] DELETE /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d04f694-0eba-46c3-a617-97d3de666de8", "name": "network-vif-unplugged", "status": "completed", "tag": "e7556e77-8734-4ef9-b260-2503b06b73bc"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:36:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a0ae2b57-113f-466b-8b03-74eaf43f190a tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 200 len: 1500 microversion: 2.1 time: 0.256473 Apr 14 00:36:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 428/967] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:36:37 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 1500 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:36:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Creating event network-vif-unplugged:e7556e77-8734-4ef9-b260-2503b06b73bc for instance 2d04f694-0eba-46c3-a617-97d3de666de8 on user Apr 14 00:36:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042805 Apr 14 00:36:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 436/968] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:36:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:37 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HTTP exception thrown: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Request method failure captured: Apr 14 00:36:37 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 HTTP/1.1 Apr 14 00:36:37 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:36:37 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:36:37 user devstack@n-api.service[72775]: Connection: close Apr 14 00:36:37 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:36:37 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:36:37 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:36:37 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:36:37 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJ6uESs8WWwxPkuZDTFk9MV25kZEbY8kSRpZTtplsN5je1j_FODBVcgZNdtHU1YDq027aVuJ8t8Q8xRi1somj6iHqzB3FEQEYZScaB1A86GaIV4hzu1Fcc8VFgmJ5v1j63D0_DVk5VbILA6MnZy12_rHyLtSe8T0iklcGW57fCmFCy0 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Project-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46777f523af54eecb0e3260f14df7909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Tenant: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Tenant-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:36:37 user devstack@n-api.service[72775]: X-User: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:36:37 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:36:37 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:36:37 user devstack@n-api.service[72775]: X-User-Id: e5ad76f13b78448887913c4d0bcb16af Apr 14 00:36:37 user devstack@n-api.service[72775]: X-User-Name: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:36:37 user devstack@n-api.service[72775]: method: > Apr 14 00:36:37 user devstack@n-api.service[72775]: exception: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. Apr 14 00:36:37 user devstack@n-api.service[72775]: action_args: {'id': '61d1abb2-3c80-48de-a26b-1c8030081105'} Apr 14 00:36:37 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. Apr 14 00:36:37 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:36:37 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Returning 404 to user: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:36:37 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-d946abda-c8e9-4c2e-a5d7-b10ec5f390c9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105" status: 404 len: 111 microversion: 2.1 time: 0.029262 Apr 14 00:36:37 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 105/969] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:36:37 2023] GET /compute/v2.1/servers/61d1abb2-3c80-48de-a26b-1c8030081105 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:36:37 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f5debbbc-1471-42c9-a376-60bfaea5555b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '.version_select at 0x7f3db6b02440>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f5debbbc-1471-42c9-a376-60bfaea5555b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1820486155" status: 202 len: 0 microversion: 2.1 time: 0.026213 Apr 14 00:36:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 429/970] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 00:36:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1820486155 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:36:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d04f694-0eba-46c3-a617-97d3de666de8", "name": "network-vif-deleted", "tag": "e7556e77-8734-4ef9-b260-2503b06b73bc"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] Creating event network-vif-deleted:e7556e77-8734-4ef9-b260-2503b06b73bc for instance 2d04f694-0eba-46c3-a617-97d3de666de8 on user Apr 14 00:36:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093795 Apr 14 00:36:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 437/971] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:39 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d04f694-0eba-46c3-a617-97d3de666de8", "name": "network-vif-plugged", "status": "completed", "tag": "e7556e77-8734-4ef9-b260-2503b06b73bc"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Creating event network-vif-plugged:e7556e77-8734-4ef9-b260-2503b06b73bc for instance 2d04f694-0eba-46c3-a617-97d3de666de8 on user Apr 14 00:36:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026988 Apr 14 00:36:39 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 106/972] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7a43cd11-c2d3-4df2-91a2-dc6dea8e510d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'create', calling method: .version_select at 0x7f3db68f3130>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1685780787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU8iJCvLdXte1ng454W6MPjmwOaCNiooSbUzryCYaPKsm+elaQXxHL7pJqwwJUB3WBM5uXW0vPbCSXH/dGpXulUINeoD4fVc77lCjWDhdsnf0Qt5ZAqjG8F4xyRbxqxJg=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:40 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-7a43cd11-c2d3-4df2-91a2-dc6dea8e510d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for project 46777f523af54eecb0e3260f14df7909. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:36:40 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-7a43cd11-c2d3-4df2-91a2-dc6dea8e510d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for user e5ad76f13b78448887913c4d0bcb16af and project 46777f523af54eecb0e3260f14df7909. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:36:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-7a43cd11-c2d3-4df2-91a2-dc6dea8e510d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.070359 Apr 14 00:36:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 430/973] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:36:40 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1367836214", "imageRef": "11c4f6c7-2375-4030-96df-c731bbfc9a8a", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1685780787", "networks": [{"uuid": "d7b8d180-999a-4f41-b677-e83b1c24a8a9"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] validate_networks() for [('d7b8d180-999a-4f41-b677-e83b1c24a8a9', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for project 46777f523af54eecb0e3260f14df7909. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting quotas for user e5ad76f13b78448887913c4d0bcb16af and project 46777f523af54eecb0e3260f14df7909. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:36:40 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11c4f6c7-2375-4030-96df-c731bbfc9a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:36:40 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.555368 Apr 14 00:36:40 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 438/974] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:36:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:36:40 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-12ca4369-239b-41f6-ae90-ff0826f13e5a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:36:40 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-12ca4369-239b-41f6-ae90-ff0826f13e5a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:36:41 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-12ca4369-239b-41f6-ae90-ff0826f13e5a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:36:41 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-12ca4369-239b-41f6-ae90-ff0826f13e5a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1253 microversion: 2.1 time: 0.120106 Apr 14 00:36:41 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 107/975] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:36:40 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1253 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:36:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Creating event network-changed:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:36:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031485 Apr 14 00:36:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 431/976] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-plugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Creating event network-vif-plugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:36:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087847 Apr 14 00:36:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 439/977] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:36:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:36:47 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-plugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:36:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:36:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:36:47 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:36:47 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Creating event network-vif-plugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:36:47 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034753 Apr 14 00:36:47 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 108/978] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:36:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:37:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] HTTP exception thrown: Instance 2d04f694-0eba-46c3-a617-97d3de666de8 could not be found. Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Request method failure captured: Apr 14 00:37:27 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 HTTP/1.1 Apr 14 00:37:27 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:37:27 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:37:27 user devstack@n-api.service[72773]: Connection: close Apr 14 00:37:27 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:37:27 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:37:27 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:37:27 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:37:27 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOJ4IjjObSgxtPkVvvCFlOP5weVu6bpKkfkGZ7pBH9H5TISr7dhQ70Zm29HPT0u0M2Kf0CbS0imgCI9ZJWNLp3QbPYhXsdOpdvm_47Z1gaVeoy7AwV9neuVpseu59qFdDMojehiQ2W3-ysQjt2l3TpFT52QP3pYr34cFbmqrMPmVIL1Y Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Project-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Project-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e46ba54fdcdb45368f457001f26a281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Tenant: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Tenant-Id: e46ba54fdcdb45368f457001f26a281b Apr 14 00:37:27 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-ServersNegativeTestJSON-495782531 Apr 14 00:37:27 user devstack@n-api.service[72773]: X-User: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:37:27 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:37:27 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:37:27 user devstack@n-api.service[72773]: X-User-Id: 67248d6b437547918b0cc2b0cdf29536 Apr 14 00:37:27 user devstack@n-api.service[72773]: X-User-Name: tempest-ServersNegativeTestJSON-495782531-project-member Apr 14 00:37:27 user devstack@n-api.service[72773]: method: > Apr 14 00:37:27 user devstack@n-api.service[72773]: exception: Instance 2d04f694-0eba-46c3-a617-97d3de666de8 could not be found. Apr 14 00:37:27 user devstack@n-api.service[72773]: action_args: {'id': '2d04f694-0eba-46c3-a617-97d3de666de8'} Apr 14 00:37:27 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d04f694-0eba-46c3-a617-97d3de666de8 could not be found. Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d04f694-0eba-46c3-a617-97d3de666de8 could not be found. Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d04f694-0eba-46c3-a617-97d3de666de8 could not be found. Apr 14 00:37:27 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:37:27 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Returning 404 to user: Instance 2d04f694-0eba-46c3-a617-97d3de666de8 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:37:27 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-8ca23116-f1b5-43c9-9068-cecd09090f22 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8" status: 404 len: 111 microversion: 2.1 time: 0.041726 Apr 14 00:37:27 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 432/979] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:37:27 2023] GET /compute/v2.1/servers/2d04f694-0eba-46c3-a617-97d3de666de8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=10 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:37:31 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:37:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-b1124014-7243-4e78-a8b0-c00fa7e7214b tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1538 microversion: 2.1 time: 0.349423 Apr 14 00:37:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 440/980] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:37:31 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1538 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:38:31 user devstack@n-api.service[72775]: Fri Apr 14 00:38:31 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc (ip 10.0.0.210) !!! Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:31 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:38:31 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-8f1e07b1-1734-468c-994b-55561fd06438 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1538 microversion: 2.1 time: 0.210367 Apr 14 00:38:31 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 109/981] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:38:31 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1538 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Searching by: {'deleted': False, 'project_id': '46777f523af54eecb0e3260f14df7909'} {{(pid=72773) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:31 user devstack@n-api.service[72773]: DEBUG nova.compute.multi_cell_list [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72773) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 00:38:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0885677e-2b54-4e50-9c34-1d967c2298ca tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.083707 Apr 14 00:38:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 433/982] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 00:38:31 2023] GET /compute/v2.1/servers => generated 341 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:31 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:38:31 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-0e2cc8d0-87a8-4fa0-813e-d4698119dcd4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1538 microversion: 2.1 time: 0.169547 Apr 14 00:38:31 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 441/983] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:38:31 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1538 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17f3af17-ec13-4449-90ee-4b4f2375cd14"}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:35 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400610 Apr 14 00:38:35 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 110/984] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 00:38:34 2023] POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:41 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:38:41 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-ad2d8ed9-103e-49ec-bdc4-71866ec97aa6 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1584 microversion: 2.1 time: 0.195978 Apr 14 00:38:41 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 434/985] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:38:41 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1584 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:38:43 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:43 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:43 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:43 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Creating event network-changed:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:38:43 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Apr 14 00:38:43 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 442/986] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-57997663"}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:45 user devstack@n-api.service[72775]: INFO nova.network.security_group_api [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Adding security group 3f50ed7c-3e78-4328-b2b0-aa6bfebc4168 to port 79b2086a-dcff-4bb6-893c-d852a886de1d Apr 14 00:38:46 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-95159c40-cf53-486d-9312-165ad6007df9 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.559313 Apr 14 00:38:46 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 111/987] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:38:45 2023] POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Creating event network-changed:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:38:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051093 Apr 14 00:38:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 435/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:38:46 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:38:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-511743cb-5b3c-4b6a-a574-6fca4913e0b4 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1747 microversion: 2.1 time: 0.716700 Apr 14 00:38:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 443/989] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:38:46 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1747 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:46 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.086717 Apr 14 00:38:46 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 112/990] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:38:46 2023] POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:47 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:38:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-7d9c8d9c-0ee9-4239-8c2a-6326aa76a3a5 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1739 microversion: 2.1 time: 0.189539 Apr 14 00:38:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 436/991] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:38:46 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:38:50 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-unplugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:50 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Creating event network-vif-unplugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:38:50 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031402 Apr 14 00:38:50 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 444/992] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:38:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-plugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Creating event network-vif-plugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:38:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 Apr 14 00:38:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 113/993] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:38:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:38:54 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-plugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}, {"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-plugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:38:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:38:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:38:54 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:38:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Creating event network-vif-plugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:38:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Creating event network-vif-plugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:38:54 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035684 Apr 14 00:38:54 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 437/994] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:38:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=10 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:39:37 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:39:37 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-3b339344-3638-469b-b57f-72d9b641070c tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1747 microversion: 2.1 time: 0.223583 Apr 14 00:39:37 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 445/995] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:39:37 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1747 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:40:37 user devstack@n-api.service[72775]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 14 00:40:37 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:40:37 user devstack@n-api.service[72775]: Fri Apr 14 00:40:37 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action (ip 10.0.0.210) !!! Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-57997663"}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:37 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:37 user devstack@n-api.service[72775]: INFO nova.network.security_group_api [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Removing security group 3f50ed7c-3e78-4328-b2b0-aa6bfebc4168 from port 79b2086a-dcff-4bb6-893c-d852a886de1d Apr 14 00:40:38 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-cdf516a2-c7f4-484e-809f-1a8d212b1081 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.823388 Apr 14 00:40:38 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 114/996] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:40:37 2023] POST /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/action => generated 0 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:40:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=10 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=24 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:40:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Creating event network-changed:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:40:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046452 Apr 14 00:40:38 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 438/997] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:39 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:40:39 user devstack@n-api.service[72774]: Fri Apr 14 00:40:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14 (ip 10.0.0.210) !!! Apr 14 00:40:39 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:40:39 user devstack@n-api.service[72774]: Fri Apr 14 00:40:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14 (ip 10.0.0.210) !!! Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:39 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'services' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 00:40:39 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14" status: 202 len: 0 microversion: 2.1 time: 0.179851 Apr 14 00:40:39 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 446/998] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:40:39 2023] DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:39 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49288. Apr 14 00:40:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f2deeea9-4e32-4f9a-874b-6dc14ceee286 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050739 Apr 14 00:40:39 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 115/999] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:40:39 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:40:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:40:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:40:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:40:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:40:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Creating event network-changed:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:40:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032622 Apr 14 00:40:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 439/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:41:29 user devstack@n-api.service[72774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-46ae93bb-9a40-4cd2-9d83-6c42f9840539 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.276778 Apr 14 00:41:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 447/1001] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 00:41:29 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments => generated 25 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=10 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:29 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 00:41:29 user devstack@n-api.service[72775]: Fri Apr 14 00:41:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14 (ip 10.0.0.210) !!! Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:29 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HTTP exception thrown: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is not attached to volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Request method failure captured: Apr 14 00:41:29 user devstack@n-api.service[72775]: request: DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14 HTTP/1.1 Apr 14 00:41:29 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:41:29 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:41:29 user devstack@n-api.service[72775]: Connection: close Apr 14 00:41:29 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:41:29 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:41:29 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:41:29 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:41:29 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJ6uESs8WWwxPkuZDTFk9MV25kZEbY8kSRpZTtplsN5je1j_FODBVcgZNdtHU1YDq027aVuJ8t8Q8xRi1somj6iHqzB3FEQEYZScaB1A86GaIV4hzu1Fcc8VFgmJ5v1j63D0_DVk5VbILA6MnZy12_rHyLtSe8T0iklcGW57fCmFCy0 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Project-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46777f523af54eecb0e3260f14df7909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Tenant: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Tenant-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:41:29 user devstack@n-api.service[72775]: X-User: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:41:29 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:41:29 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:41:29 user devstack@n-api.service[72775]: X-User-Id: e5ad76f13b78448887913c4d0bcb16af Apr 14 00:41:29 user devstack@n-api.service[72775]: X-User-Name: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:41:29 user devstack@n-api.service[72775]: method: > Apr 14 00:41:29 user devstack@n-api.service[72775]: exception: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is not attached to volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 Apr 14 00:41:29 user devstack@n-api.service[72775]: action_args: {'server_id': '0580f210-dd0b-4fc4-bcb2-e3db659e9cdc', 'id': '17f3af17-ec13-4449-90ee-4b4f2375cd14'} Apr 14 00:41:29 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 17f3af17-ec13-4449-90ee-4b4f2375cd14. Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is not attached to volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is not attached to volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 Apr 14 00:41:29 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:41:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Returning 404 to user: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is not attached to volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:41:29 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-bc5cfe4c-e8aa-4b6c-baf8-24990e0a882d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14" status: 404 len: 154 microversion: 2.1 time: 0.131902 Apr 14 00:41:29 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 116/1002] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 00:41:29 2023] DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/os-volume_attachments/17f3af17-ec13-4449-90ee-4b4f2375cd14 => generated 154 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:33 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:41:33 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 204 len: 0 microversion: 2.1 time: 0.176579 Apr 14 00:41:33 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 440/1003] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:41:33 2023] DELETE /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:33 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51434. Apr 14 00:41:33 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:41:33 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4db0df24-7bd9-492b-805f-131c2bc19563 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 200 len: 1544 microversion: 2.1 time: 0.276614 Apr 14 00:41:33 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 448/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:41:33 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 1544 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:41:33 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-unplugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:41:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:33 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:33 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Creating event network-vif-unplugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:41:33 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070511 Apr 14 00:41:33 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 117/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:41:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-deleted", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:41:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] Creating event network-vif-deleted:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:41:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030608 Apr 14 00:41:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 441/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:41:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc", "name": "network-vif-plugged", "status": "completed", "tag": "79b2086a-dcff-4bb6-893c-d852a886de1d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:41:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:41:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:41:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:41:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Creating event network-vif-plugged:79b2086a-dcff-4bb6-893c-d852a886de1d for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc on user Apr 14 00:41:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 Apr 14 00:41:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 449/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:41:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:42:23 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HTTP exception thrown: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc could not be found. Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Request method failure captured: Apr 14 00:42:23 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc HTTP/1.1 Apr 14 00:42:23 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:42:23 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:42:23 user devstack@n-api.service[72775]: Connection: close Apr 14 00:42:23 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:42:23 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:42:23 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:42:23 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:42:23 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOJ6uESs8WWwxPkuZDTFk9MV25kZEbY8kSRpZTtplsN5je1j_FODBVcgZNdtHU1YDq027aVuJ8t8Q8xRi1somj6iHqzB3FEQEYZScaB1A86GaIV4hzu1Fcc8VFgmJ5v1j63D0_DVk5VbILA6MnZy12_rHyLtSe8T0iklcGW57fCmFCy0 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Project-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46777f523af54eecb0e3260f14df7909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46777f523af54eecb0e3260f14df7909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Tenant: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Tenant-Id: 46777f523af54eecb0e3260f14df7909 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestMinimumBasicScenario-598834355 Apr 14 00:42:23 user devstack@n-api.service[72775]: X-User: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:42:23 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:42:23 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:42:23 user devstack@n-api.service[72775]: X-User-Id: e5ad76f13b78448887913c4d0bcb16af Apr 14 00:42:23 user devstack@n-api.service[72775]: X-User-Name: tempest-TestMinimumBasicScenario-598834355-project-member Apr 14 00:42:23 user devstack@n-api.service[72775]: method: > Apr 14 00:42:23 user devstack@n-api.service[72775]: exception: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc could not be found. Apr 14 00:42:23 user devstack@n-api.service[72775]: action_args: {'id': '0580f210-dd0b-4fc4-bcb2-e3db659e9cdc'} Apr 14 00:42:23 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc could not be found. Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc could not be found. Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc could not be found. Apr 14 00:42:23 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:42:23 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Returning 404 to user: Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:42:23 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-abafd44f-5d97-499b-a650-bf7a8a229052 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" status: 404 len: 111 microversion: 2.1 time: 0.038244 Apr 14 00:42:23 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 118/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:42:23 2023] GET /compute/v2.1/servers/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:42:23 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:23 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e55ff4f7-4f37-4d80-a391-abcf14cdbbee tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Calling method '.version_select at 0x7f3db68f2f80>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:42:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e55ff4f7-4f37-4d80-a391-abcf14cdbbee tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1685780787" status: 202 len: 0 microversion: 2.1 time: 0.035120 Apr 14 00:42:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 442/1009] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 00:42:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1685780787 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 00:42:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=14 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1536217770", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "a7e35933-c830-4d32-abde-a95c31b23f63", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6dec18bc-e73b-450e-b0d2-e36653017f20"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:42:53 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] validate_networks() for [('6dec18bc-e73b-450e-b0d2-e36653017f20', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:42:54 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a7e35933-c830-4d32-abde-a95c31b23f63',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:42:54 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.883699 Apr 14 00:42:54 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 450/1010] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:42:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:42:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-8507e7db-edeb-45fc-a25c-b39033b80ff7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:42:54 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-8507e7db-edeb-45fc-a25c-b39033b80ff7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:42:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:54 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-8507e7db-edeb-45fc-a25c-b39033b80ff7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:42:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-8507e7db-edeb-45fc-a25c-b39033b80ff7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 200 len: 1052 microversion: 2.1 time: 0.145911 Apr 14 00:42:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 119/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:42:54 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 1052 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:42:57 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:57 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:42:57 user devstack@n-api.service[72773]: Fri Apr 14 00:42:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 00:42:57 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84a5b31-1959-4a5e-88f5-66b6a0179b09", "tag": "5d572ef8-2fc4-4431-b8be-efd367a8866a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:42:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:42:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:42:57 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:42:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Creating event network-changed:5d572ef8-2fc4-4431-b8be-efd367a8866a for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 on user Apr 14 00:42:57 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100346 Apr 14 00:42:57 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 443/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a5b31-1959-4a5e-88f5-66b6a0179b09", "name": "network-vif-plugged", "status": "completed", "tag": "5d572ef8-2fc4-4431-b8be-efd367a8866a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:43:08 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:43:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Creating event network-vif-plugged:5d572ef8-2fc4-4431-b8be-efd367a8866a for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 on user Apr 14 00:43:08 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105752 Apr 14 00:43:08 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 451/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:43:10 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a5b31-1959-4a5e-88f5-66b6a0179b09", "name": "network-vif-plugged", "status": "completed", "tag": "5d572ef8-2fc4-4431-b8be-efd367a8866a"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:43:10 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:10 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:43:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:43:10 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:43:10 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Creating event network-vif-plugged:5d572ef8-2fc4-4431-b8be-efd367a8866a for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 on user Apr 14 00:43:10 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032909 Apr 14 00:43:10 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 120/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:43:44 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:43:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3bf8731c-d620-423b-b9d9-0b18a6abb627 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 200 len: 1379 microversion: 2.1 time: 0.210213 Apr 14 00:43:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 444/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:43:44 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 1379 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:44 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:44:44 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-74153f69-233d-49ad-8f73-604ea99b3eeb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 200 len: 1379 microversion: 2.1 time: 0.176781 Apr 14 00:44:44 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 452/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:44:44 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 1379 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:44:44 user devstack@n-api.service[72775]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:44 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:44:44 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-585a6f84-e782-4984-8b7f-87c258d82fe0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 200 len: 1379 microversion: 2.1 time: 0.166623 Apr 14 00:44:44 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 121/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:44:44 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 1379 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:45 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:44:45 user devstack@n-api.service[72773]: Fri Apr 14 00:44:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 (ip 10.0.0.210) !!! Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:45 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:44:45 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 204 len: 0 microversion: 2.1 time: 0.124065 Apr 14 00:44:45 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 445/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:44:45 2023] DELETE /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:45 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:44:45 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-c0df805d-e260-444f-9ecd-4accd109bba5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 200 len: 1385 microversion: 2.1 time: 0.168937 Apr 14 00:44:45 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 453/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:44:45 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 1385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:44:45 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a5b31-1959-4a5e-88f5-66b6a0179b09", "name": "network-vif-unplugged", "status": "completed", "tag": "5d572ef8-2fc4-4431-b8be-efd367a8866a"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:44:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:45 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:45 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Creating event network-vif-unplugged:5d572ef8-2fc4-4431-b8be-efd367a8866a for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 on user Apr 14 00:44:45 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033241 Apr 14 00:44:45 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 122/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:44:47 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a5b31-1959-4a5e-88f5-66b6a0179b09", "name": "network-vif-deleted", "tag": "5d572ef8-2fc4-4431-b8be-efd367a8866a"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:44:47 user devstack@n-api.service[72773]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e147ad7-2e10-4fac-b321-ca4195f37d59] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 00:44:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:47 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] Creating event network-vif-deleted:5d572ef8-2fc4-4431-b8be-efd367a8866a for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 on user Apr 14 00:44:47 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032359 Apr 14 00:44:47 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 446/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:44:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:44:47 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a5b31-1959-4a5e-88f5-66b6a0179b09", "name": "network-vif-plugged", "status": "completed", "tag": "5d572ef8-2fc4-4431-b8be-efd367a8866a"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:44:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:44:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:44:47 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:44:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Creating event network-vif-plugged:5d572ef8-2fc4-4431-b8be-efd367a8866a for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 on user Apr 14 00:44:47 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Apr 14 00:44:47 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 454/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:44:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:35 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:45:35 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 HTTP/1.1 Apr 14 00:45:35 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:45:35 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:45:35 user devstack@n-api.service[72775]: Connection: close Apr 14 00:45:35 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:45:35 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:45:35 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:45:35 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:45:35 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:45:35 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72775]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:45:35 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:45:35 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:45:35 user devstack@n-api.service[72775]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:45:35 user devstack@n-api.service[72775]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:45:35 user devstack@n-api.service[72775]: method: > Apr 14 00:45:35 user devstack@n-api.service[72775]: exception: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72775]: action_args: {'id': 'b84a5b31-1959-4a5e-88f5-66b6a0179b09'} Apr 14 00:45:35 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:45:35 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-800d43cc-d9fb-40b1-ad66-be10970cc412 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 404 len: 111 microversion: 2.1 time: 0.043195 Apr 14 00:45:35 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 123/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:45:35 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:35 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e147ad7-2e10-4fac-b321-ca4195f37d59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45866. Apr 14 00:45:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:45:35 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 HTTP/1.1 Apr 14 00:45:35 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:45:35 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:45:35 user devstack@n-api.service[72773]: Connection: close Apr 14 00:45:35 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:45:35 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:45:35 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:45:35 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:45:35 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:45:35 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72773]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:45:35 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:45:35 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:45:35 user devstack@n-api.service[72773]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:45:35 user devstack@n-api.service[72773]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:45:35 user devstack@n-api.service[72773]: method: > Apr 14 00:45:35 user devstack@n-api.service[72773]: exception: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72773]: action_args: {'id': 'b84a5b31-1959-4a5e-88f5-66b6a0179b09'} Apr 14 00:45:35 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:45:35 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6277a2ac-0cae-4b97-939e-fc627ea21ef8 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 404 len: 111 microversion: 2.1 time: 0.043400 Apr 14 00:45:35 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 447/1024] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:45:35 2023] DELETE /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=14 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:45:35 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 HTTP/1.1 Apr 14 00:45:35 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:45:35 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:45:35 user devstack@n-api.service[72774]: Connection: close Apr 14 00:45:35 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:45:35 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:45:35 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:45:35 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:45:35 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:45:35 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:45:35 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:45:35 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:45:35 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:45:35 user devstack@n-api.service[72774]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:45:35 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:45:35 user devstack@n-api.service[72774]: method: > Apr 14 00:45:35 user devstack@n-api.service[72774]: exception: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72774]: action_args: {'id': 'b84a5b31-1959-4a5e-88f5-66b6a0179b09'} Apr 14 00:45:35 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. Apr 14 00:45:35 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:45:35 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:45:35 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-fbdb770f-6de9-45f0-a436-a1b30c80d24f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09" status: 404 len: 111 microversion: 2.1 time: 0.037023 Apr 14 00:45:35 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 455/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:45:35 2023] GET /compute/v2.1/servers/b84a5b31-1959-4a5e-88f5-66b6a0179b09 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:45:43 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-425557895", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "12bc0a58-041c-488e-a961-6c37f530e1b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6dec18bc-e73b-450e-b0d2-e36653017f20"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:45:43 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45854. Apr 14 00:45:43 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] validate_networks() for [('6dec18bc-e73b-450e-b0d2-e36653017f20', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:45:44 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12bc0a58-041c-488e-a961-6c37f530e1b9',volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:45:44 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.767327 Apr 14 00:45:44 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 124/1026] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:45:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:45:44 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1a1e5dbe-3253-4459-b336-e9a19898958e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:45:44 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1a1e5dbe-3253-4459-b336-e9a19898958e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:45:44 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-1a1e5dbe-3253-4459-b336-e9a19898958e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:45:44 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1a1e5dbe-3253-4459-b336-e9a19898958e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 200 len: 1065 microversion: 2.1 time: 0.066067 Apr 14 00:45:44 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 448/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:45:44 2023] GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 1065 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:45:46 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:46 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace", "tag": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:45:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:46 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Creating event network-changed:b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace on user Apr 14 00:45:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042939 Apr 14 00:45:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 456/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:45:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace", "name": "network-vif-plugged", "status": "completed", "tag": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:45:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Creating event network-vif-plugged:b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace on user Apr 14 00:45:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144265 Apr 14 00:45:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 125/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace", "name": "network-vif-plugged", "status": "completed", "tag": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:45:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:45:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Creating event network-vif-plugged:b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace on user Apr 14 00:45:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037124 Apr 14 00:45:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 449/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:45:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:46:34 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:46:34 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-861eabd9-e70c-470a-ad0d-654a4e288cab tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 200 len: 1393 microversion: 2.1 time: 0.179457 Apr 14 00:46:34 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 457/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:46:34 2023] GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:34 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:47:34 user devstack@n-api.service[72775]: Fri Apr 14 00:47:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace (ip 10.0.0.210) !!! Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:35 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:47:35 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-1618f640-8353-4307-8a2a-71eca15cecf1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 200 len: 1393 microversion: 2.1 time: 0.172315 Apr 14 00:47:35 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 126/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:47:34 2023] GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:35 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:47:35 user devstack@n-api.service[72773]: Fri Apr 14 00:47:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace/action (ip 10.0.0.210) !!! Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2041946704"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:35 user devstack@n-api.service[72773]: INFO nova.compute.api [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Attempting to quiesce instance before volume snapshot. Apr 14 00:47:35 user devstack@n-api.service[72773]: INFO nova.compute.api [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 00:47:35 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Creating snapshot from volume 12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=72773) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 00:47:37 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-bb3f7998-efea-47c2-aba2-cec3353a7e5e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace/action" status: 202 len: 0 microversion: 2.1 time: 2.566638 Apr 14 00:47:37 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 450/1033] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 00:47:35 2023] POST /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace/action => generated 0 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 00:47:37 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:37 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:37 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2057599137", "imageRef": "723c5f4e-00ac-49cc-8038-c025741dcb57", "flavorRef": "42", "networks": [{"uuid": "6dec18bc-e73b-450e-b0d2-e36653017f20"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:47:37 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] validate_networks() for [('6dec18bc-e73b-450e-b0d2-e36653017f20', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:47:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='fecef658-19bb-4067-83f9-27e3c2e3f0d7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:47:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.553131 Apr 14 00:47:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 458/1034] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:47:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:47:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-e5c2b165-6c81-4e95-9f70-1a53964cada1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:47:38 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-e5c2b165-6c81-4e95-9f70-1a53964cada1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:47:38 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-e5c2b165-6c81-4e95-9f70-1a53964cada1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:47:38 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-e5c2b165-6c81-4e95-9f70-1a53964cada1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 200 len: 1224 microversion: 2.1 time: 0.116927 Apr 14 00:47:38 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 127/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:47:38 2023] GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:47:40 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:47:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:40 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Creating event network-changed:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:47:40 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060606 Apr 14 00:47:40 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 451/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:47:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-plugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Creating event network-vif-plugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:47:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036197 Apr 14 00:47:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 459/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-plugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:47:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:47:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Creating event network-vif-plugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:47:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034128 Apr 14 00:47:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 128/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:47:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:48:28 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:48:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9124cf81-ce0f-4c07-97a0-b601b690220f tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 200 len: 1551 microversion: 2.1 time: 0.242144 Apr 14 00:48:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 452/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:48:28 2023] GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 1551 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:28 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:29 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:49:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-76f343dd-42e3-4602-87ec-db1a85bcf6b0 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 200 len: 1551 microversion: 2.1 time: 0.221490 Apr 14 00:49:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 460/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:49:28 2023] GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 1551 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:29 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Going to try to terminate instance {{(pid=72775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:49:29 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 204 len: 0 microversion: 2.1 time: 0.127792 Apr 14 00:49:29 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 129/1041] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:49:29 2023] DELETE /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:29 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:49:29 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a38f7764-6cc3-4e9e-970f-bf88a9713892 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 200 len: 1557 microversion: 2.1 time: 0.205303 Apr 14 00:49:29 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 453/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:49:29 2023] GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 1557 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:49:29 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-unplugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:49:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:29 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Creating event network-vif-unplugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:29 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028181 Apr 14 00:49:29 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 461/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:49:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:49:31 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-deleted", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:49:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:31 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:31 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] Creating event network-vif-deleted:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:31 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138859 Apr 14 00:49:31 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 130/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:49:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:49:31 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-plugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}, {"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-plugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}, {"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-plugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}, {"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-unplugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}, {"server_uuid": "1aa2f565-f4cf-4979-875f-0a5d34b6c121", "name": "network-vif-plugged", "status": "completed", "tag": "6053af7f-223a-471f-9738-c6335cd621c0"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:49:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:49:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:49:31 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:49:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Creating event network-vif-plugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Creating event network-vif-plugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Creating event network-vif-plugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Creating event network-vif-unplugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Creating event network-vif-plugged:6053af7f-223a-471f-9738-c6335cd621c0 for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 on user Apr 14 00:49:31 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034776 Apr 14 00:49:31 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 454/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:49:31 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=8 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:19 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 00:50:19 user devstack@n-api.service[72774]: Fri Apr 14 00:50:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 (ip 10.0.0.210) !!! Apr 14 00:50:19 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 00:50:19 user devstack@n-api.service[72774]: Fri Apr 14 00:50:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 (ip 10.0.0.210) !!! Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:50:19 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 HTTP/1.1 Apr 14 00:50:19 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:50:19 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:50:19 user devstack@n-api.service[72774]: Connection: close Apr 14 00:50:19 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:50:19 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:50:19 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:50:19 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:50:19 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:50:19 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:50:19 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:50:19 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:50:19 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:50:19 user devstack@n-api.service[72774]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:50:19 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:50:19 user devstack@n-api.service[72774]: method: > Apr 14 00:50:19 user devstack@n-api.service[72774]: exception: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:50:19 user devstack@n-api.service[72774]: action_args: {'id': '1aa2f565-f4cf-4979-875f-0a5d34b6c121'} Apr 14 00:50:19 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:50:19 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:50:19 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:50:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-394298b0-94cb-4c46-a8aa-3e99e869f309 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 404 len: 111 microversion: 2.1 time: 0.047575 Apr 14 00:50:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 462/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:50:19 2023] GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:21 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Going to try to terminate instance {{(pid=72775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:50:22 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 204 len: 0 microversion: 2.1 time: 0.130160 Apr 14 00:50:22 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 131/1047] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:50:21 2023] DELETE /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:22 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:50:22 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-4669d81b-ba64-4e04-932d-f856be0affaa tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 200 len: 1399 microversion: 2.1 time: 0.213243 Apr 14 00:50:22 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 455/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:50:22 2023] GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 1399 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:50:22 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace", "name": "network-vif-unplugged", "status": "completed", "tag": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:50:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:22 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Creating event network-vif-unplugged:b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace on user Apr 14 00:50:22 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029617 Apr 14 00:50:22 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 463/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:50:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:50:23 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace", "name": "network-vif-deleted", "tag": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:50:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:23 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:23 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] Creating event network-vif-deleted:b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace on user Apr 14 00:50:23 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035584 Apr 14 00:50:23 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 132/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:50:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:50:24 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace", "name": "network-vif-plugged", "status": "completed", "tag": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:50:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:50:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:50:24 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:50:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Creating event network-vif-plugged:b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace on user Apr 14 00:50:24 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028844 Apr 14 00:50:24 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 456/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:50:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:51:12 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace HTTP/1.1 Apr 14 00:51:12 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:51:12 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:51:12 user devstack@n-api.service[72774]: Connection: close Apr 14 00:51:12 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:51:12 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:51:12 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:51:12 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:51:12 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72774]: method: > Apr 14 00:51:12 user devstack@n-api.service[72774]: exception: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: action_args: {'id': 'b80a7b33-5a5f-4db3-8d3a-0a9e9946aace'} Apr 14 00:51:12 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:51:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-04980088-3426-452a-ab64-389c379be5de tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 404 len: 111 microversion: 2.1 time: 0.031262 Apr 14 00:51:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 464/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:51:12 2023] GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:51:12 user devstack@n-api.service[72775]: request: DELETE /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 HTTP/1.1 Apr 14 00:51:12 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:51:12 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:51:12 user devstack@n-api.service[72775]: Connection: close Apr 14 00:51:12 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:51:12 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:51:12 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:51:12 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:51:12 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72775]: method: > Apr 14 00:51:12 user devstack@n-api.service[72775]: exception: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: action_args: {'id': '1aa2f565-f4cf-4979-875f-0a5d34b6c121'} Apr 14 00:51:12 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:51:12 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-1607f3d9-1e70-419a-8738-e4270c9f306a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 404 len: 111 microversion: 2.1 time: 0.034891 Apr 14 00:51:12 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 133/1053] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:51:12 2023] DELETE /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:51:12 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 HTTP/1.1 Apr 14 00:51:12 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:51:12 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:51:12 user devstack@n-api.service[72773]: Connection: close Apr 14 00:51:12 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:51:12 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:51:12 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:51:12 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:51:12 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72773]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72773]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:51:12 user devstack@n-api.service[72773]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72773]: method: > Apr 14 00:51:12 user devstack@n-api.service[72773]: exception: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72773]: action_args: {'id': '1aa2f565-f4cf-4979-875f-0a5d34b6c121'} Apr 14 00:51:12 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. Apr 14 00:51:12 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:51:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-3e54fcfd-6552-4593-91b4-c829c412471c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121" status: 404 len: 111 microversion: 2.1 time: 0.033565 Apr 14 00:51:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 457/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:51:12 2023] GET /compute/v2.1/servers/1aa2f565-f4cf-4979-875f-0a5d34b6c121 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:51:12 user devstack@n-api.service[72774]: request: DELETE /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace HTTP/1.1 Apr 14 00:51:12 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:51:12 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:51:12 user devstack@n-api.service[72774]: Connection: close Apr 14 00:51:12 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:51:12 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:51:12 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:51:12 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:51:12 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:51:12 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72774]: method: > Apr 14 00:51:12 user devstack@n-api.service[72774]: exception: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: action_args: {'id': 'b80a7b33-5a5f-4db3-8d3a-0a9e9946aace'} Apr 14 00:51:12 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:51:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-361a7c91-c824-42ea-9def-f1de2b8360d5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 404 len: 111 microversion: 2.1 time: 0.029805 Apr 14 00:51:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 465/1055] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:51:12 2023] DELETE /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:12 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:51:12 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace HTTP/1.1 Apr 14 00:51:12 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:51:12 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:51:12 user devstack@n-api.service[72775]: Connection: close Apr 14 00:51:12 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:51:12 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:51:12 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:51:12 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:51:12 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:51:12 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:51:12 user devstack@n-api.service[72775]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:51:12 user devstack@n-api.service[72775]: method: > Apr 14 00:51:12 user devstack@n-api.service[72775]: exception: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: action_args: {'id': 'b80a7b33-5a5f-4db3-8d3a-0a9e9946aace'} Apr 14 00:51:12 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. Apr 14 00:51:12 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:51:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:51:12 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-03e36bfa-db47-49b0-8661-5dadf3c6d7fb tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" status: 404 len: 111 microversion: 2.1 time: 0.027310 Apr 14 00:51:12 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 134/1056] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:51:12 2023] GET /compute/v2.1/servers/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-149c6842-124b-4f60-87f0-2a440e38fedf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: .version_select at 0x7f3db68f0af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-128892553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-149c6842-124b-4f60-87f0-2a440e38fedf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:51:12 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-149c6842-124b-4f60-87f0-2a440e38fedf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:51:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-149c6842-124b-4f60-87f0-2a440e38fedf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048434 Apr 14 00:51:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 458/1057] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 00:51:12 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:51:17 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-67870164", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-128892553", "security_groups": [{"name": "tempest-secgroup-smoke-18646096"}], "block_device_mapping_v2": [{"uuid": "8a7edaa8-f67a-4251-8117-62a322c53de7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6dec18bc-e73b-450e-b0d2-e36653017f20"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] validate_networks() for [('6dec18bc-e73b-450e-b0d2-e36653017f20', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:51:18 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:51:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:51:19 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a7edaa8-f67a-4251-8117-62a322c53de7',volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:51:19 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.237178 Apr 14 00:51:19 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 466/1058] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:51:17 2023] POST /compute/v2.1/servers => generated 402 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:51:19 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-a47998ac-365c-42a4-a6af-8dff81ffa8cf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:51:19 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-a47998ac-365c-42a4-a6af-8dff81ffa8cf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:51:19 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-a47998ac-365c-42a4-a6af-8dff81ffa8cf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:51:19 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-a47998ac-365c-42a4-a6af-8dff81ffa8cf tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 200 len: 1087 microversion: 2.1 time: 0.160218 Apr 14 00:51:19 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 135/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:51:19 2023] GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 1087 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:51:21 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:51:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:21 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Creating event network-changed:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:51:21 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037243 Apr 14 00:51:21 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 459/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "name": "network-vif-plugged", "status": "completed", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:30 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Creating event network-vif-plugged:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:51:30 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086616 Apr 14 00:51:30 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 467/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:51:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "name": "network-vif-plugged", "status": "completed", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=8 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:51:32 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:51:32 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Creating event network-vif-plugged:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:51:32 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055994 Apr 14 00:51:32 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 136/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:51:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:52:09 user devstack@n-api.service[72773]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e147ad7-2e10-4fac-b321-ca4195f37d59] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:09 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:52:09 user devstack@n-api.service[72773]: Fri Apr 14 00:52:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af (ip 10.0.0.210) !!! Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:52:09 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:52:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-51041b8c-d44f-4306-b719-59b3f062096e tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 200 len: 1439 microversion: 2.1 time: 0.170627 Apr 14 00:52:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 460/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:52:09 2023] GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 1439 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:09 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:53:09 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-9cc003b3-9b7c-411b-81f7-68e07eef4c65 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 200 len: 1439 microversion: 2.1 time: 0.389456 Apr 14 00:53:09 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 468/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:53:09 2023] GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 1439 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 00:53:11 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:11 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:11 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:53:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Creating event network-changed:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:53:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041423 Apr 14 00:53:11 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 137/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:12 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e147ad7-2e10-4fac-b321-ca4195f37d59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41386. Apr 14 00:53:12 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:53:12 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 204 len: 0 microversion: 2.1 time: 0.122160 Apr 14 00:53:12 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 461/1066] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:53:11 2023] DELETE /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:12 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:53:12 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8662c952-e67b-4729-9e15-ed292be95cb6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 200 len: 1445 microversion: 2.1 time: 0.243642 Apr 14 00:53:12 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 469/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:53:12 2023] GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 1445 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:53:13 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "name": "network-vif-unplugged", "status": "completed", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}, {"server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "name": "network-vif-plugged", "status": "completed", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:53:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:13 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Creating event network-vif-unplugged:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:53:13 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Creating event network-vif-plugged:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:53:13 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028332 Apr 14 00:53:13 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 138/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:53:13 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:53:14 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782ea87f-f55e-4aab-8501-ac17f3bc59af", "name": "network-vif-deleted", "tag": "d261fca7-16e0-4d71-acff-7ae3017459ae"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:53:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:53:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:53:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:53:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] Creating event network-vif-deleted:d261fca7-16e0-4d71-acff-7ae3017459ae for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af on user Apr 14 00:53:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030696 Apr 14 00:53:14 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 462/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=12 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:02 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 00:54:02 user devstack@n-api.service[72774]: Fri Apr 14 00:54:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af (ip 10.0.0.210) !!! Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:54:02 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af HTTP/1.1 Apr 14 00:54:02 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:54:02 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:54:02 user devstack@n-api.service[72774]: Connection: close Apr 14 00:54:02 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:54:02 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:54:02 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:54:02 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:54:02 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:54:02 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:54:02 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:54:02 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:54:02 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:54:02 user devstack@n-api.service[72774]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:54:02 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:54:02 user devstack@n-api.service[72774]: method: > Apr 14 00:54:02 user devstack@n-api.service[72774]: exception: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:54:02 user devstack@n-api.service[72774]: action_args: {'id': '782ea87f-f55e-4aab-8501-ac17f3bc59af'} Apr 14 00:54:02 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:54:02 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:54:02 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:54:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-19abe0d2-b7e1-469f-b754-755280a497dc tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 404 len: 111 microversion: 2.1 time: 0.040983 Apr 14 00:54:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 470/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:54:02 2023] GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:54:02 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1369633049", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-128892553", "security_groups": [{"name": "tempest-secgroup-smoke-18646096"}], "block_device_mapping_v2": [{"uuid": "8a7edaa8-f67a-4251-8117-62a322c53de7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6dec18bc-e73b-450e-b0d2-e36653017f20"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:54:02 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:02 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:02 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 00:54:02 user devstack@n-api.service[72775]: Fri Apr 14 00:54:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 00:54:02 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 00:54:02 user devstack@n-api.service[72775]: Fri Apr 14 00:54:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 00:54:02 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] validate_networks() for [('6dec18bc-e73b-450e-b0d2-e36653017f20', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:54:03 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a7edaa8-f67a-4251-8117-62a322c53de7',volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:54:03 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.903960 Apr 14 00:54:03 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 139/1071] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:54:02 2023] POST /compute/v2.1/servers => generated 402 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:54:03 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:03 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:03 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-0161bbbc-b069-4dc5-8dfe-a45a9fa8ba03 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:54:03 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-0161bbbc-b069-4dc5-8dfe-a45a9fa8ba03 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:54:03 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-0161bbbc-b069-4dc5-8dfe-a45a9fa8ba03 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:54:03 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-0161bbbc-b069-4dc5-8dfe-a45a9fa8ba03 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" status: 200 len: 1089 microversion: 2.1 time: 0.109385 Apr 14 00:54:03 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 463/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:54:03 2023] GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => generated 1089 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:54:05 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:54:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:05 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:05 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36346. Apr 14 00:54:05 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Creating event network-changed:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:54:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042194 Apr 14 00:54:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 471/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:54:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:54:11 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "name": "network-vif-plugged", "status": "completed", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:54:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Creating event network-vif-plugged:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:54:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049711 Apr 14 00:54:11 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 140/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:54:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:54:13 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "name": "network-vif-plugged", "status": "completed", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:54:13 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:13 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:13 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:13 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Creating event network-vif-plugged:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:54:13 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038598 Apr 14 00:54:13 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 464/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:54:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:54:53 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:54:53 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-1c5f439e-1030-4033-a8d3-8d88c1287778 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" status: 200 len: 1441 microversion: 2.1 time: 0.224656 Apr 14 00:54:53 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 472/1076] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:54:53 2023] GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => generated 1441 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:55:53 user devstack@n-api.service[72775]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:55:53 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:55:54 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:55:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-b69796d5-4c0c-4a8e-857f-a7e32bf0cf6d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" status: 200 len: 1441 microversion: 2.1 time: 0.179153 Apr 14 00:55:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 141/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:55:53 2023] GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => generated 1441 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:55:55 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:55:55 user devstack@n-api.service[72773]: Fri Apr 14 00:55:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 00:55:55 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:55:55 user devstack@n-api.service[72773]: Fri Apr 14 00:55:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 00:55:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:55:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:55:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:55:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:55:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Creating event network-changed:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:55:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145264 Apr 14 00:55:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 465/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:01 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:56:01 user devstack@n-api.service[72774]: Fri Apr 14 00:56:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 00:56:01 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:56:01 user devstack@n-api.service[72774]: Fri Apr 14 00:56:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-907038285", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-128892553", "security_groups": [{"name": "tempest-secgroup-smoke-18646096"}], "block_device_mapping_v2": [{"uuid": "5f9b46b9-9e36-44ab-a556-a4e4360bc408", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6dec18bc-e73b-450e-b0d2-e36653017f20"}]}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] validate_networks() for [('6dec18bc-e73b-450e-b0d2-e36653017f20', None, None, None, None, None)] {{(pid=72774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.quota [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting quotas for user cfb66031fcf84659a3b80cdb76ffddc0 and project 0934526a2dfa45f4bd5df4edee11d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=72774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Going to run 1 instances... {{(pid=72774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 00:56:01 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f9b46b9-9e36-44ab-a556-a4e4360bc408',volume_size=None,volume_type=None)] {{(pid=72774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 00:56:02 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.776634 Apr 14 00:56:02 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 473/1079] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 00:56:01 2023] POST /compute/v2.1/servers => generated 402 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 00:56:02 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-fb3987e7-a042-414a-a223-d419a52a92d7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:56:02 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-fb3987e7-a042-414a-a223-d419a52a92d7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:56:02 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51810. Apr 14 00:56:02 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-fb3987e7-a042-414a-a223-d419a52a92d7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:56:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-fb3987e7-a042-414a-a223-d419a52a92d7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67" status: 200 len: 1088 microversion: 2.1 time: 0.086489 Apr 14 00:56:02 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 142/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:56:02 2023] GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 => generated 1088 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:56:04 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:56:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:04 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Creating event network-changed:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:56:04 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029579 Apr 14 00:56:04 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 466/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:56:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:56:10 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "name": "network-vif-plugged", "status": "completed", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:56:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:10 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Creating event network-vif-plugged:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:56:10 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128140 Apr 14 00:56:10 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 474/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "name": "network-vif-plugged", "status": "completed", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:12 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:12 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Creating event network-vif-plugged:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:56:12 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Apr 14 00:56:12 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 143/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:56:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:56:52 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:56:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1a821ed3-1cb3-47c4-81b0-69c78b7f6fb1 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67" status: 200 len: 1440 microversion: 2.1 time: 0.212952 Apr 14 00:56:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 467/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:56:52 2023] GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 => generated 1440 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:57:52 user devstack@n-api.service[72774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=4 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:52 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:57:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-85d1c428-5f65-4e8c-b6d9-413e23851548 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67" status: 200 len: 1440 microversion: 2.1 time: 0.162634 Apr 14 00:57:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 475/1085] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:57:52 2023] GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:57:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:54 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:54 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:57:54 user devstack@n-api.service[72775]: Fri Apr 14 00:57:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 00:57:54 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:57:54 user devstack@n-api.service[72775]: Fri Apr 14 00:57:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 00:57:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:57:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Creating event network-changed:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:57:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048465 Apr 14 00:57:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 144/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:57:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:55 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Going to try to terminate instance {{(pid=72773) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:57:55 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67" status: 204 len: 0 microversion: 2.1 time: 0.114774 Apr 14 00:57:55 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 468/1087] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:57:55 2023] DELETE /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:55 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:55 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 48202. Apr 14 00:57:56 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:57:56 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-30e4bbed-f8bd-41fe-9abd-9951d668d0a7 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67" status: 200 len: 1565 microversion: 2.1 time: 0.165856 Apr 14 00:57:56 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 476/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:57:55 2023] GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:57:56 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:57:56 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:56 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:56 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:56 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Creating event network-changed:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:57:56 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033814 Apr 14 00:57:56 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 145/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:57:56 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "name": "network-vif-unplugged", "status": "completed", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:57:56 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:56 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:56 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Creating event network-vif-unplugged:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:57:56 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061235 Apr 14 00:57:56 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 469/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:57:58 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "name": "network-vif-deleted", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:57:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:58 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] Creating event network-vif-deleted:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:57:58 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031831 Apr 14 00:57:58 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 477/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:57:58 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5054773-9558-4f36-8230-aa37370f4f67", "name": "network-vif-plugged", "status": "completed", "tag": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:57:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:57:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:57:58 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:57:58 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Creating event network-vif-plugged:168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance a5054773-9558-4f36-8230-aa37370f4f67 on user Apr 14 00:57:58 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035757 Apr 14 00:57:58 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 146/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e147ad7-2e10-4fac-b321-ca4195f37d59] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance a5054773-9558-4f36-8230-aa37370f4f67 could not be found. Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:58:46 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 HTTP/1.1 Apr 14 00:58:46 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:58:46 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:58:46 user devstack@n-api.service[72773]: Connection: close Apr 14 00:58:46 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:58:46 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:58:46 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:58:46 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:58:46 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:58:46 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:58:46 user devstack@n-api.service[72773]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:58:46 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:58:46 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:58:46 user devstack@n-api.service[72773]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:58:46 user devstack@n-api.service[72773]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:58:46 user devstack@n-api.service[72773]: method: > Apr 14 00:58:46 user devstack@n-api.service[72773]: exception: Instance a5054773-9558-4f36-8230-aa37370f4f67 could not be found. Apr 14 00:58:46 user devstack@n-api.service[72773]: action_args: {'id': 'a5054773-9558-4f36-8230-aa37370f4f67'} Apr 14 00:58:46 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5054773-9558-4f36-8230-aa37370f4f67 could not be found. Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5054773-9558-4f36-8230-aa37370f4f67 could not be found. Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5054773-9558-4f36-8230-aa37370f4f67 could not be found. Apr 14 00:58:46 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:58:46 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance a5054773-9558-4f36-8230-aa37370f4f67 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:58:46 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-97f52bbc-9077-4614-91df-254f5ab1cdc6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67" status: 404 len: 111 microversion: 2.1 time: 0.188884 Apr 14 00:58:46 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 470/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:58:46 2023] GET /compute/v2.1/servers/a5054773-9558-4f36-8230-aa37370f4f67 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=14 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:58:52 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:58:52 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:52 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:52 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Creating event network-changed:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:58:52 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Apr 14 00:58:52 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 147/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:58:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:58:52 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 00:58:52 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" status: 204 len: 0 microversion: 2.1 time: 0.135089 Apr 14 00:58:52 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 478/1095] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:58:52 2023] DELETE /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:52 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e147ad7-2e10-4fac-b321-ca4195f37d59] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60934. Apr 14 00:58:52 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 00:58:52 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-393cfab5-41c3-403d-b470-755177aca128 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" status: 200 len: 1566 microversion: 2.1 time: 0.311725 Apr 14 00:58:52 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 471/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:58:52 2023] GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => generated 1566 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 00:58:54 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "name": "network-vif-unplugged", "status": "completed", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}, {"server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "name": "network-vif-plugged", "status": "completed", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}, {"server_uuid": "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7", "name": "network-vif-deleted", "tag": "d339fae5-6ce4-49ea-85eb-45933ebf36eb"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 00:58:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:58:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:58:54 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:58:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Creating event network-vif-unplugged:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:58:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Creating event network-vif-plugged:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:58:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Creating event network-vif-deleted:d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 on user Apr 14 00:58:54 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035673 Apr 14 00:58:54 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 148/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 00:58:54 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:42 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:59:42 user devstack@n-api.service[72774]: Fri Apr 14 00:59:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 (ip 10.0.0.210) !!! Apr 14 00:59:42 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 00:59:42 user devstack@n-api.service[72774]: Fri Apr 14 00:59:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 (ip 10.0.0.210) !!! Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:59:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.wsgi [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 could not be found. Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:59:42 user devstack@n-api.service[72774]: request: GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 HTTP/1.1 Apr 14 00:59:42 user devstack@n-api.service[72774]: Accept: application/json Apr 14 00:59:42 user devstack@n-api.service[72774]: Accept-Encoding: identity Apr 14 00:59:42 user devstack@n-api.service[72774]: Connection: close Apr 14 00:59:42 user devstack@n-api.service[72774]: Content-Length: 0 Apr 14 00:59:42 user devstack@n-api.service[72774]: Content-Type: application/json Apr 14 00:59:42 user devstack@n-api.service[72774]: Host: 10.0.0.210 Apr 14 00:59:42 user devstack@n-api.service[72774]: Openstack-System-Scope: None Apr 14 00:59:42 user devstack@n-api.service[72774]: User-Agent: python-urllib3/1.26.15 Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Domain-Id: None Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Domain-Name: None Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Identity-Status: Confirmed Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Is-Admin-Project: True Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Project-Domain-Id: default Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Project-Domain-Name: Default Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Role: member,reader Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Roles: member,reader Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:59:42 user devstack@n-api.service[72774]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:42 user devstack@n-api.service[72774]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:59:42 user devstack@n-api.service[72774]: X-User-Domain-Id: default Apr 14 00:59:42 user devstack@n-api.service[72774]: X-User-Domain-Name: Default Apr 14 00:59:42 user devstack@n-api.service[72774]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:59:42 user devstack@n-api.service[72774]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:59:42 user devstack@n-api.service[72774]: method: > Apr 14 00:59:42 user devstack@n-api.service[72774]: exception: Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 could not be found. Apr 14 00:59:42 user devstack@n-api.service[72774]: action_args: {'id': '98479cbe-09c7-40ee-a5cc-1b872dd9fbf7'} Apr 14 00:59:42 user devstack@n-api.service[72774]: {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 could not be found. Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 could not be found. Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 could not be found. Apr 14 00:59:42 user devstack@n-api.service[72774]: ERROR nova.api.openstack.wsgi Apr 14 00:59:42 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 could not be found. {{(pid=72774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:59:42 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-efd506df-bfda-4df1-92c0-e2259682b516 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" status: 404 len: 111 microversion: 2.1 time: 0.051883 Apr 14 00:59:42 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 479/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:59:42 2023] GET /compute/v2.1/servers/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=8 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:59:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:59:43 user devstack@n-api.service[72773]: request: DELETE /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af HTTP/1.1 Apr 14 00:59:43 user devstack@n-api.service[72773]: Accept: application/json Apr 14 00:59:43 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 00:59:43 user devstack@n-api.service[72773]: Connection: close Apr 14 00:59:43 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 00:59:43 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 00:59:43 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 00:59:43 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 00:59:43 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:59:43 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:43 user devstack@n-api.service[72773]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:59:43 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 00:59:43 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 00:59:43 user devstack@n-api.service[72773]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:59:43 user devstack@n-api.service[72773]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:59:43 user devstack@n-api.service[72773]: method: > Apr 14 00:59:43 user devstack@n-api.service[72773]: exception: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72773]: action_args: {'id': '782ea87f-f55e-4aab-8501-ac17f3bc59af'} Apr 14 00:59:43 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:59:43 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-af66eff9-1139-4335-9cdb-ce0f500b2797 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 404 len: 111 microversion: 2.1 time: 0.035501 Apr 14 00:59:43 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 472/1099] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 00:59:43 2023] DELETE /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 00:59:43 user devstack@n-api.service[72775]: INFO nova.api.openstack.wsgi [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HTTP exception thrown: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Request method failure captured: Apr 14 00:59:43 user devstack@n-api.service[72775]: request: GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af HTTP/1.1 Apr 14 00:59:43 user devstack@n-api.service[72775]: Accept: application/json Apr 14 00:59:43 user devstack@n-api.service[72775]: Accept-Encoding: identity Apr 14 00:59:43 user devstack@n-api.service[72775]: Connection: close Apr 14 00:59:43 user devstack@n-api.service[72775]: Content-Length: 0 Apr 14 00:59:43 user devstack@n-api.service[72775]: Content-Type: application/json Apr 14 00:59:43 user devstack@n-api.service[72775]: Host: 10.0.0.210 Apr 14 00:59:43 user devstack@n-api.service[72775]: Openstack-System-Scope: None Apr 14 00:59:43 user devstack@n-api.service[72775]: User-Agent: python-urllib3/1.26.15 Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Auth-Token: gAAAAABkOKF_frGfTDgoht2VKmet8Dp01OpJpl73P6MJKO6GoMuyub3OVasqJqbLhfw5a-av7bTirDrx1lEAnXzhIGQsSOd5VLM5nq7TnnsKyrejALhdTR2FNRBNS4WlSLz0bSRcZUe8Op1-AFn0hdgGn5yiyD74yusJL-AY6l1E0LYWRN7Jfu4 Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Domain-Id: None Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Domain-Name: None Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Identity-Status: Confirmed Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Is-Admin-Project: True Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Project-Domain-Id: default Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Project-Domain-Name: Default Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Project-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Project-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Role: member,reader Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Roles: member,reader Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0934526a2dfa45f4bd5df4edee11d98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Tenant: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Tenant-Id: 0934526a2dfa45f4bd5df4edee11d98a Apr 14 00:59:43 user devstack@n-api.service[72775]: X-Tenant-Name: tempest-TestVolumeBootPattern-260409128 Apr 14 00:59:43 user devstack@n-api.service[72775]: X-User: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:59:43 user devstack@n-api.service[72775]: X-User-Domain-Id: default Apr 14 00:59:43 user devstack@n-api.service[72775]: X-User-Domain-Name: Default Apr 14 00:59:43 user devstack@n-api.service[72775]: X-User-Id: cfb66031fcf84659a3b80cdb76ffddc0 Apr 14 00:59:43 user devstack@n-api.service[72775]: X-User-Name: tempest-TestVolumeBootPattern-260409128-project-member Apr 14 00:59:43 user devstack@n-api.service[72775]: method: > Apr 14 00:59:43 user devstack@n-api.service[72775]: exception: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72775]: action_args: {'id': '782ea87f-f55e-4aab-8501-ac17f3bc59af'} Apr 14 00:59:43 user devstack@n-api.service[72775]: {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. Apr 14 00:59:43 user devstack@n-api.service[72775]: ERROR nova.api.openstack.wsgi Apr 14 00:59:43 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Returning 404 to user: Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af could not be found. {{(pid=72775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 00:59:43 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-0bbc9eab-912b-4541-9593-7355cc6e00b5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af" status: 404 len: 111 microversion: 2.1 time: 0.035332 Apr 14 00:59:43 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 149/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 00:59:43 2023] GET /compute/v2.1/servers/782ea87f-f55e-4aab-8501-ac17f3bc59af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 00:59:46 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4199c8ec-2d51-4f11-abba-6b52138d8058 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Calling method '.version_select at 0x7f3db643fa30>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 00:59:46 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4199c8ec-2d51-4f11-abba-6b52138d8058 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-128892553" status: 202 len: 0 microversion: 2.1 time: 0.030146 Apr 14 00:59:46 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 480/1101] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 00:59:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-128892553 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:00:08 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:08 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:08 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:00:08 user devstack@n-api.service[72773]: Fri Apr 14 01:00:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 14 01:00:08 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:00:08 user devstack@n-api.service[72773]: Fri Apr 14 01:00:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 14 01:00:09 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-1928ec08-aaef-4021-afa1-ea4535103cb1 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Action: 'create', calling method: .version_select at 0x7f3db6668f70>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-920739646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF7w2+KjkkyJvNhd0vZprUfWYDPfNpaHTuDIX2lnLWSf6LX0U1r92inKRclfrXIDyWHz54xSsmhgtoY5GgciU/WUNeudS1fxVYXH4mrtpL0yTxtyHmVWIHfvCWuegCjw=="}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:00:09 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-1928ec08-aaef-4021-afa1-ea4535103cb1 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting quotas for project ed63b19014f048f5bf3f9938a151d30c. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:00:09 user devstack@n-api.service[72773]: DEBUG nova.quota [None req-1928ec08-aaef-4021-afa1-ea4535103cb1 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting quotas for user 1c8816bdfcab4ebca17b0c7ca90e5d39 and project ed63b19014f048f5bf3f9938a151d30c. Resources: {'key_pairs'} {{(pid=72773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:00:09 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-1928ec08-aaef-4021-afa1-ea4535103cb1 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.275901 Apr 14 01:00:09 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 473/1102] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:00:08 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:00:10 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-944954764", "imageRef": "6db62068-7278-4cd8-b41f-d0140d89e199", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-920739646", "security_groups": [{"name": "tempest-secgroup-smoke-1897793079"}], "networks": [{"uuid": "c6603c41-74dd-4b44-952c-0df4228a8b77"}]}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:00:10 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:10 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:10 user devstack@n-api.service[72775]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] validate_networks() for [('c6603c41-74dd-4b44-952c-0df4228a8b77', None, None, None, None, None)] {{(pid=72775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flavor limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Image limits 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flavor pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Image pref 0:0:0 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting quotas for project ed63b19014f048f5bf3f9938a151d30c. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.quota [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting quotas for user 1c8816bdfcab4ebca17b0c7ca90e5d39 and project ed63b19014f048f5bf3f9938a151d30c. Resources: {'cores', 'ram', 'instances'} {{(pid=72775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Going to run 1 instances... {{(pid=72775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:00:11 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6db62068-7278-4cd8-b41f-d0140d89e199',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:00:11 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.862918 Apr 14 01:00:11 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 150/1103] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:00:10 2023] POST /compute/v2.1/servers => generated 404 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:00:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:11 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:11 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-4db0752d-f397-40c0-afeb-ac02e1113b99 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:00:11 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-4db0752d-f397-40c0-afeb-ac02e1113b99 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:00:11 user devstack@n-api.service[72774]: DEBUG nova.policy [None req-4db0752d-f397-40c0-afeb-ac02e1113b99 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8816bdfcab4ebca17b0c7ca90e5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63b19014f048f5bf3f9938a151d30c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:00:11 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-4db0752d-f397-40c0-afeb-ac02e1113b99 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7" status: 200 len: 1255 microversion: 2.1 time: 0.201774 Apr 14 01:00:11 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 481/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:00:11 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 => generated 1255 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:00:14 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:00:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:00:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:00:14 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:00:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.compute.server_external_events [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Creating event network-changed:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:00:14 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036332 Apr 14 01:00:14 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 474/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:00:16 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "name": "network-vif-plugged", "status": "completed", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:00:16 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:00:16 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:00:16 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:00:16 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Creating event network-vif-plugged:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:00:16 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040290 Apr 14 01:00:16 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 151/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:00:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:00:18 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "name": "network-vif-plugged", "status": "completed", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:00:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:00:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:00:18 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:00:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Creating event network-vif-plugged:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:00:18 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041561 Apr 14 01:00:18 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 482/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:00:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell0:SELECT=4 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:01:01 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8816bdfcab4ebca17b0c7ca90e5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63b19014f048f5bf3f9938a151d30c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:01:01 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-514b4c1d-347d-4636-b419-788b19f4468d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7" status: 200 len: 1567 microversion: 2.1 time: 0.184882 Apr 14 01:01:01 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 475/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:01:01 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell0:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:01 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:02 user devstack@n-api.service[72775]: DEBUG nova.policy [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8816bdfcab4ebca17b0c7ca90e5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63b19014f048f5bf3f9938a151d30c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:02:02 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-91f56661-4828-4aee-9433-d6c9272cc562 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7" status: 200 len: 1567 microversion: 2.1 time: 0.276308 Apr 14 01:02:02 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 152/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:02:01 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:02:06 user devstack@n-api.service[72774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell0:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:06 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Creating event network-changed:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "741de32b-bc3e-4427-a231-40e54c136117"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:06 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:06 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141279 Apr 14 01:02:06 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 483/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:02:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:02:06 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572520 Apr 14 01:02:06 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 476/1111] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:02:06 2023] POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:21 user devstack@n-api.service[72775]: DEBUG nova.objects.instance [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'services' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=72775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:02:21 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/741de32b-bc3e-4427-a231-40e54c136117" status: 202 len: 0 microversion: 2.1 time: 0.242048 Apr 14 01:02:21 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 153/1112] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:02:21 2023] DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/741de32b-bc3e-4427-a231-40e54c136117 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:21 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39644. Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:02:21 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:02:21 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-8ee38bb8-d469-4a86-bbc2-2108ff7a0004 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153202 Apr 14 01:02:21 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 484/1113] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:02:21 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:11 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:11 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-2f16f0f2-6e31-482c-9136-ff3258171182 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055929 Apr 14 01:03:11 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 477/1114] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:03:11 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:14 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:03:14 user devstack@n-api.service[72775]: Fri Apr 14 01:03:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 01:03:14 user devstack@n-api.service[72775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:03:14 user devstack@n-api.service[72775]: Fri Apr 14 01:03:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c7f118b-fbc9-4f79-8d22-e15c5677aed5"}} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:14 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:14 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431369 Apr 14 01:03:14 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 154/1115] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:03:14 2023] POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:23 user devstack@n-api.service[72774]: DEBUG nova.objects.instance [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'services' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=72774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:03:23 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/2c7f118b-fbc9-4f79-8d22-e15c5677aed5" status: 202 len: 0 microversion: 2.1 time: 0.263860 Apr 14 01:03:23 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 485/1116] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:03:23 2023] DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/2c7f118b-fbc9-4f79-8d22-e15c5677aed5 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:03:23 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:03:23 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6b00d803-495f-425b-9c49-5d7060cf9d05 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055101 Apr 14 01:03:23 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 478/1117] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:03:23 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:13 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:13 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-f9f412ea-cb81-416b-8f48-73efde7fb437 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057556 Apr 14 01:04:13 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 155/1118] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:04:13 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f94c5daf-01f1-4cd1-9137-28be67b2ef8e"}} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:17 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:17 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343943 Apr 14 01:04:17 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 486/1119] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:04:17 2023] POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:04:25 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:04:25 user devstack@n-api.service[72773]: Fri Apr 14 01:04:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/f94c5daf-01f1-4cd1-9137-28be67b2ef8e (ip 10.0.0.210) !!! Apr 14 01:04:25 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:04:25 user devstack@n-api.service[72773]: Fri Apr 14 01:04:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/f94c5daf-01f1-4cd1-9137-28be67b2ef8e (ip 10.0.0.210) !!! Apr 14 01:04:25 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:04:25 user devstack@n-api.service[72773]: Fri Apr 14 01:04:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/f94c5daf-01f1-4cd1-9137-28be67b2ef8e (ip 10.0.0.210) !!! Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:25 user devstack@n-api.service[72773]: DEBUG nova.objects.instance [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'services' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:04:25 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/f94c5daf-01f1-4cd1-9137-28be67b2ef8e" status: 202 len: 0 microversion: 2.1 time: 0.276647 Apr 14 01:04:25 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 479/1120] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:04:25 2023] DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/f94c5daf-01f1-4cd1-9137-28be67b2ef8e => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:04:25 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:04:25 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-26a66ace-59e1-4f66-99c9-f43227777b74 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053069 Apr 14 01:04:25 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 156/1121] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:04:25 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:16 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:16 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-5d73070c-a8bc-4391-80a0-e6b3c01f7caa tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104984 Apr 14 01:05:16 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 487/1122] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:05:16 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb5808d3-0dee-4531-988a-5d464f60c87c"}} {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:18 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:19 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280865 Apr 14 01:05:19 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 480/1123] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:05:18 2023] POST /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=6 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG nova.compute.api [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:26 user devstack@n-api.service[72775]: DEBUG nova.objects.instance [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'services' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=72775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:05:26 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/eb5808d3-0dee-4531-988a-5d464f60c87c" status: 202 len: 0 microversion: 2.1 time: 0.181229 Apr 14 01:05:26 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 157/1124] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:05:26 2023] DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments/eb5808d3-0dee-4531-988a-5d464f60c87c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:05:26 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:05:26 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-7b858367-5e75-4879-a7ca-61b419a90fe5 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053703 Apr 14 01:05:26 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 488/1125] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:05:26 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:16 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:16 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e323bf05-ff33-4494-acd6-ec4b3b85c882 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049832 Apr 14 01:06:16 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 481/1126] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:06:16 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:06:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=2 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:34 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:34 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:06:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:34 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Creating event network-changed:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:06:34 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137036 Apr 14 01:06:34 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 158/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:06:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:06:38 user devstack@n-api.service[72774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 01:06:38 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:06:38 user devstack@n-api.service[72774]: Fri Apr 14 01:06:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 (ip 10.0.0.210) !!! Apr 14 01:06:38 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:06:38 user devstack@n-api.service[72774]: Fri Apr 14 01:06:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 (ip 10.0.0.210) !!! Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_api:SELECT=2 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG dbcounter [-] [72774] Writing DB stats nova_cell1:SELECT=6 {{(pid=72774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:38 user devstack@n-api.service[72774]: DEBUG nova.compute.api [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Going to try to terminate instance {{(pid=72774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:06:38 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7" status: 204 len: 0 microversion: 2.1 time: 0.144624 Apr 14 01:06:38 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 489/1128] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:06:38 2023] DELETE /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:38 user devstack@n-api.service[72773]: DEBUG nova.policy [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8816bdfcab4ebca17b0c7ca90e5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63b19014f048f5bf3f9938a151d30c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:06:38 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-6a3e61f3-4c13-4ddd-b73e-9309df5a9fe9 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7" status: 200 len: 1573 microversion: 2.1 time: 0.253791 Apr 14 01:06:38 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 482/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:06:38 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 => generated 1573 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:06:38 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "name": "network-vif-unplugged", "status": "completed", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:06:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:39 user devstack@n-api.service[72775]: DEBUG oslo_concurrency.lockutils [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.compute.server_external_events [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Creating event network-vif-unplugged:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:06:39 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125197 Apr 14 01:06:39 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 159/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:06:41 user devstack@n-api.service[72774]: DEBUG nova.api.openstack.wsgi [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "name": "network-vif-plugged", "status": "completed", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}, {"server_uuid": "7d067330-8745-4e21-b93c-60c0902012c7", "name": "network-vif-deleted", "tag": "4f9eadfb-1571-4235-85ba-05511a343c4d"}]} {{(pid=72774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:06:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:06:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:06:41 user devstack@n-api.service[72774]: DEBUG oslo_concurrency.lockutils [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:06:41 user devstack@n-api.service[72774]: INFO oslo.messaging._drivers.impl_rabbit [-] [7eccef60-7c56-4aa0-8e0c-ab0fd67800d5] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45712. Apr 14 01:06:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Creating event network-vif-plugged:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:06:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.compute.server_external_events [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Creating event network-vif-deleted:4f9eadfb-1571-4235-85ba-05511a343c4d for instance 7d067330-8745-4e21-b93c-60c0902012c7 on user Apr 14 01:06:41 user devstack@n-api.service[72774]: INFO nova.api.openstack.requestlog [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034685 Apr 14 01:06:41 user devstack@n-api.service[72774]: [pid: 72774|app: 0|req: 490/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '>' {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG nova.compute.api [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Fetching instance by UUID {{(pid=72773) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_api:SELECT=2 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG dbcounter [-] [72773] Writing DB stats nova_cell1:SELECT=6 {{(pid=72773) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:28 user devstack@n-api.service[72773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 01:07:28 user devstack@n-api.service[72773]: Fri Apr 14 01:07:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 (ip 10.0.0.210) !!! Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "6321059f-07f5-4513-ac20-9516172f61da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG oslo_concurrency.lockutils [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "6321059f-07f5-4513-ac20-9516172f61da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72773) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:07:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.wsgi [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] HTTP exception thrown: Instance 7d067330-8745-4e21-b93c-60c0902012c7 could not be found. Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Request method failure captured: Apr 14 01:07:28 user devstack@n-api.service[72773]: request: GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 HTTP/1.1 Apr 14 01:07:28 user devstack@n-api.service[72773]: Accept: application/json Apr 14 01:07:28 user devstack@n-api.service[72773]: Accept-Encoding: identity Apr 14 01:07:28 user devstack@n-api.service[72773]: Connection: close Apr 14 01:07:28 user devstack@n-api.service[72773]: Content-Length: 0 Apr 14 01:07:28 user devstack@n-api.service[72773]: Content-Type: application/json Apr 14 01:07:28 user devstack@n-api.service[72773]: Host: 10.0.0.210 Apr 14 01:07:28 user devstack@n-api.service[72773]: Openstack-System-Scope: None Apr 14 01:07:28 user devstack@n-api.service[72773]: User-Agent: python-urllib3/1.26.15 Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Auth-Token: gAAAAABkOKWRQwUL8aRmiQ3urbTPWf5d16I5F1P_VhiH5HyR0GiKBGZRYb_pYi-BdmYYGj2vCw-8tGVY3t1uSnYD-MV34CSGMJkrOJuPssbB7KjzED-jhd79362wuepCsDlivfqgdrpE8Kz6YpaclAktggD5GwB8lQqGZeHDavj9BWpFLytAf_w Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Domain-Id: None Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Domain-Name: None Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Identity-Status: Confirmed Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Is-Admin-Project: True Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Project-Domain-Id: default Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Project-Domain-Name: Default Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Project-Id: ed63b19014f048f5bf3f9938a151d30c Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Project-Name: tempest-SnapshotDataIntegrityTests-212903653 Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Role: member,reader Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Roles: member,reader Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed63b19014f048f5bf3f9938a151d30c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed63b19014f048f5bf3f9938a151d30c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed63b19014f048f5bf3f9938a151d30c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Tenant: tempest-SnapshotDataIntegrityTests-212903653 Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Tenant-Id: ed63b19014f048f5bf3f9938a151d30c Apr 14 01:07:28 user devstack@n-api.service[72773]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-212903653 Apr 14 01:07:28 user devstack@n-api.service[72773]: X-User: tempest-SnapshotDataIntegrityTests-212903653-project-member Apr 14 01:07:28 user devstack@n-api.service[72773]: X-User-Domain-Id: default Apr 14 01:07:28 user devstack@n-api.service[72773]: X-User-Domain-Name: Default Apr 14 01:07:28 user devstack@n-api.service[72773]: X-User-Id: 1c8816bdfcab4ebca17b0c7ca90e5d39 Apr 14 01:07:28 user devstack@n-api.service[72773]: X-User-Name: tempest-SnapshotDataIntegrityTests-212903653-project-member Apr 14 01:07:28 user devstack@n-api.service[72773]: method: > Apr 14 01:07:28 user devstack@n-api.service[72773]: exception: Instance 7d067330-8745-4e21-b93c-60c0902012c7 could not be found. Apr 14 01:07:28 user devstack@n-api.service[72773]: action_args: {'id': '7d067330-8745-4e21-b93c-60c0902012c7'} Apr 14 01:07:28 user devstack@n-api.service[72773]: {{(pid=72773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d067330-8745-4e21-b93c-60c0902012c7 could not be found. Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d067330-8745-4e21-b93c-60c0902012c7 could not be found. Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d067330-8745-4e21-b93c-60c0902012c7 could not be found. Apr 14 01:07:28 user devstack@n-api.service[72773]: ERROR nova.api.openstack.wsgi Apr 14 01:07:28 user devstack@n-api.service[72773]: DEBUG nova.api.openstack.wsgi [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Returning 404 to user: Instance 7d067330-8745-4e21-b93c-60c0902012c7 could not be found. {{(pid=72773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:07:28 user devstack@n-api.service[72773]: INFO nova.api.openstack.requestlog [None req-e4e12cab-12cd-4180-a2f1-2492aea8234e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7" status: 404 len: 111 microversion: 2.1 time: 0.048941 Apr 14 01:07:28 user devstack@n-api.service[72773]: [pid: 72773|app: 0|req: 483/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:07:28 2023] GET /compute/v2.1/servers/7d067330-8745-4e21-b93c-60c0902012c7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:07:28 user devstack@n-api.service[72775]: DEBUG nova.api.openstack.wsgi [None req-7a031145-182a-4862-812c-bcba415b97f1 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Calling method '.version_select at 0x7f3db6820820>' {{(pid=72775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:07:28 user devstack@n-api.service[72775]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf9f69de-3df0-4e27-be82-9433d28a7251] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 14 01:07:28 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_api:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:28 user devstack@n-api.service[72775]: DEBUG dbcounter [-] [72775] Writing DB stats nova_cell1:SELECT=4 {{(pid=72775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:28 user devstack@n-api.service[72775]: INFO nova.api.openstack.requestlog [None req-7a031145-182a-4862-812c-bcba415b97f1 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-920739646" status: 202 len: 0 microversion: 2.1 time: 0.037733 Apr 14 01:07:28 user devstack@n-api.service[72775]: [pid: 72775|app: 0|req: 160/1133] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:07:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-920739646 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)